Sep 09 17:40:46 devstack cinder-volume[76270]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 17:40:46 devstack cinder-volume[76270]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 17:40:46 devstack cinder-volume[76270]: we strongly recommend against using it for new projects. Sep 09 17:40:46 devstack cinder-volume[76270]: If you are already using Eventlet, we recommend migrating to a different Sep 09 17:40:46 devstack cinder-volume[76270]: framework. For more detail see Sep 09 17:40:46 devstack cinder-volume[76270]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 17:40:46 devstack cinder-volume[76270]: import eventlet # noqa Sep 09 17:40:49 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 17:40:49 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 17:40:49 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 17:40:50 devstack cinder-volume[76270]: INFO dbcounter [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Registered counter for database cinder Sep 09 17:40:50 devstack cinder-volume[76270]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:40:50 devstack cinder-volume[76270]: DEBUG dbcounter [-] [76270] Writer thread running {{(pid=76270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 17:40:50 devstack cinder-volume[76270]: INFO cinder.rpc [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 17:40:50 devstack cinder-volume[76270]: INFO cinder.rpc [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 17:40:50 devstack cinder-volume[76270]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:40:50 devstack cinder-volume[76270]: INFO cinder.volume.manager [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Determined volume DB was empty at startup. Sep 09 17:40:50 devstack cinder-volume[76270]: DEBUG cinder.volume.manager [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76270) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 17:40:50 devstack cinder-volume[76270]: INFO cinder.volume.manager [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 17:40:50 devstack cinder-volume[76270]: WARNING stevedore.named [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 17:40:50 devstack cinder-volume[76270]: WARNING castellan.key_manager [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 17:40:50 devstack cinder-volume[76270]: WARNING cinder.keymgr.conf_key_mgr [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 17:40:50 devstack cinder-volume[76270]: DEBUG cinder.volume.drivers.lvm [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76270) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 09 17:40:50 devstack cinder-volume[76270]: DEBUG oslo_concurrency.processutils [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_concurrency.processutils [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.436s {{(pid=76270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:40:51 devstack cinder-volume[76270]: INFO cinder.rpc [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 09 17:40:51 devstack cinder-volume[76270]: INFO cinder.rpc [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 09 17:40:51 devstack cinder-volume[76270]: WARNING stevedore.named [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 17:40:51 devstack cinder-volume[76270]: WARNING castellan.key_manager [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 17:40:51 devstack cinder-volume[76270]: INFO cinder.volume.manager [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_db.sqlalchemy.engines [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:40:51 devstack cinder-volume[76270]: INFO oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Starting 1 workers Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Started child 76425 {{(pid=76270) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Full set of CONF: {{(pid=76270) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] ******************************************************************************** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Configuration options gathered from: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] ================================================================================ {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] allow_availability_zone_fallback = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76425]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] allow_compression_on_image_upload = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] allowed_direct_url_schemes = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] api_rate_limit = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] auth_strategy = keystone {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] az_cache_duration = 3600 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_availability_zone = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_host = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_stats_polling_interval = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backup_api_class = cinder.backup.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backup_name_template = backup-%s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backup_use_same_host = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backup_use_temp_snapshot = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] chap_password = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] chap_username = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_internal_tenant_project_id = 07bf2dbcb33b4b33adf57900c6afb124 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_internal_tenant_user_id = b050c61da0aa4cb5ae6ead63f534aee4 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cloned_volume_same_az = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cluster = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] compression_format = gzip {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] compute_api_class = cinder.compute.nova.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] config_dir = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] config_source = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] control_exchange = openstack {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] debug = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] default_availability_zone = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] default_group_type = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] default_volume_type = lvmdriver-1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] disk_geometry = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] driver_client_cert = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] driver_client_cert_key = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] driver_data_namespace = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] driver_ssl_cert_path = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] driver_ssl_cert_verify = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] driver_use_ssl = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] enable_force_upload = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] enable_new_services = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] enable_unsupported_driver = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] enforce_multipath_for_image_xfer = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] filter_function = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_api_insecure = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_api_ssl_compression = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_ca_certificates_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_catalog_info = image:glance:publicURL {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_num_retries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance_request_timeout = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] goodness_function = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] graceful_shutdown_timeout = 5 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] group_api_class = cinder.group.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] host = devstack {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_compress_on_upload = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_conversion_address_space_limit = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_conversion_cpu_limit = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_conversion_disable = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_upload_use_cinder_backend = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_upload_use_internal_tenant = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_volume_cache_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_volume_cache_max_count = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] image_volume_cache_max_size_gb = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] init_host_max_objects_retrieval = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] instance_format = [instance: %(uuid)s] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] iscsi_target_flags = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] iscsi_write_cache = on {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] iser_helper = tgtadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] iser_ip_address = 192.168.122.96 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76425]: INFO cinder.volume.manager [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] iser_port = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_color = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_config_append = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_dir = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_options = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_rotate_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_rotate_interval_type = days {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] log_rotation_type = none {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] max_age = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] max_logfile_count = 30 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] max_logfile_size_mb = 200 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] max_over_subscription_ratio = 20.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] message_reap_interval = 86400 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] message_ttl = 2592000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] migration_create_volume_timeout_secs = 300 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] monkey_patch = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] monkey_patch_modules = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] my_ip = 192.168.122.96 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] no_snapshot_gb_quota = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] num_iser_scan_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] num_shell_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] num_volume_device_scan_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] nvmeof_conn_info_version = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] nvmet_ns_id = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] nvmet_port_id = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] osapi_max_limit = 1000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] osapi_volume_ext_list = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] osapi_volume_listen_port = 8776 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] osapi_volume_use_ssl = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] osapi_volume_workers = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] per_volume_size_limit = -1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] periodic_fuzzy_delay = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] periodic_interval = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] public_endpoint = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] publish_errors = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] quota_backup_gigabytes = 1000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] quota_backups = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] quota_gigabytes = 1000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] quota_groups = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] quota_snapshots = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] quota_volumes = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] rate_limit_burst = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] rate_limit_except_level = CRITICAL {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] rate_limit_interval = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] reinit_driver_count = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] replication_device = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] report_discard_supported = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] report_interval = 120 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] reservation_clean_interval = 86400 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] reservation_expire = 86400 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] reserved_image_namespaces = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] reserved_percentage = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] rpc_response_timeout = 120 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] run_external_periodic_tasks = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] scst_target_driver = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] scst_target_iqn_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_down_time = 720 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] shell_completion = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] snapshot_name_template = snapshot-%s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] snapshot_same_host = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] split_loggers = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] state_path = /opt/stack/data/cinder {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] storage_availability_zone = nova {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] storage_protocol = iSCSI {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] syslog_log_facility = LOG_USER {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] target_helper = lioadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] target_ip_address = 192.168.122.96 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] target_port = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] target_protocol = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] target_secondary_ip_addresses = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] trace_flags = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] transport_url = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] until_refresh = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:51 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] use_chap_auth = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] use_default_quota_class = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] use_journal = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] use_json = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] use_multipath_for_image_xfer = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] use_stderr = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] use_syslog = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] verify_glance_signatures = enabled {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_api_class = cinder.volume.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_backend_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_clear = zero {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_clear_ionice = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_clear_size = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_copy_bps_limit = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_dd_blocksize = 1M {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_name_template = volume-%s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_service_inithost_offload = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volume_usage_audit_period = month {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] zoning_mode = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_concurrency.disable_process_locking = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.auth_section = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.auth_type = password {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.auth_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.cache = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.include_service_catalog = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.insecure = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.interface = public {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_password = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcache_username = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.region_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.service_type = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.backend = dogpile.cache.null {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.backend_argument = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.backend_expiration_time = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.config_prefix = cache.oslo {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.debug_cache_backend = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.enable_retry_client = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.enable_socket_keepalive = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.expiration_time = 600 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.hashclient_retry_attempts = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.memcache_dead_retry = 300 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.memcache_pool_maxsize = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.memcache_sasl_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.password = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.proxies = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.redis_db = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.redis_server = localhost:6379 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.retry_attempts = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.retry_delay = 0.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.socket_keepalive_count = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.socket_keepalive_idle = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack sudo[76429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 09 17:40:51 devstack sudo[76429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.socket_keepalive_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.socket_timeout = 1.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.tls_allowed_ciphers = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.tls_cafile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.tls_certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.tls_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.tls_keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cache.username = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] coordination.backend_url = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.asyncio_connection = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.asyncio_slave_connection = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.backend = sqlalchemy {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.connection = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.connection_debug = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.connection_parameters = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.connection_recycle_time = 3600 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.connection_trace = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.db_inc_retry_interval = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.db_max_retries = 20 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.db_max_retry_interval = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.db_retry_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.max_overflow = 50 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.max_pool_size = 5 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.max_retries = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.mysql_wsrep_sync_wait = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.pool_timeout = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.retry_interval = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.slave_connection = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.sqlite_synchronous = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.synchronous_reader = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] database.use_db_reconnect = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_tracing.insecure = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.connection_string = messaging:// {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.es_doc_type = notification {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.es_scroll_size = 10000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.es_scroll_time = 2m {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.filter_error_trace = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.hmac_keys = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.sentinel_service_name = mymaster {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.socket_timeout = 0.1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.trace_requests = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler.trace_sqlalchemy = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler_jaeger.process_tags = {} {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler_jaeger.service_name_prefix = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] profiler_otlp.service_name_prefix = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.enforce_new_defaults = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.policy_default_rule = default {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.policy_file = policy.yaml {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] privsep_osbrick.group = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] privsep_osbrick.helper_command = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] privsep_osbrick.user = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_sys_admin.group = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_sys_admin.helper_command = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] cinder_sys_admin.user = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.auth_section = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.auth_type = password {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.cafile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.collect_timing = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.insecure = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.send_service_user_token = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.split_loggers = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.timeout = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.tls_ciphers = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] service_user.tls_min_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.auth_section = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.auth_type = password {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.collect_timing = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.insecure = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.region_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.split_loggers = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.timeout = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.tls_ciphers = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] glance.tls_min_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.backend_availability_zone = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.chap_password = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.chap_username = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.disk_geometry = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.driver_client_cert = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.driver_client_cert_key = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.driver_data_namespace = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.driver_use_ssl = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.extra_capabilities = {} {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.filter_function = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.goodness_function = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.iscsi_target_flags = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.iscsi_write_cache = on {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.iser_helper = tgtadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.iser_port = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.lvm_share_target = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.lvm_type = auto {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.num_shell_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.replication_device = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.report_discard_supported = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.reserved_percentage = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.target_helper = tgtadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.target_port = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.target_protocol = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.trace_flags = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.unique_fqdn_network = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.use_chap_auth = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_backend_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_clear = zero {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_clear_ionice = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_clear_size = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_reports.file_event_handler = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_reports.log_dir = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.backend_host = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.chap_password = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.chap_username = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.disk_geometry = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.driver_client_cert = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.extra_capabilities = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.filter_function = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.goodness_function = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.iser_helper = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.iser_ip_address = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.iser_port = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.lvm_share_target = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.lvm_type = auto {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.num_shell_tries = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.replication_device = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.report_discard_supported = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.reserved_percentage = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.scst_target_driver = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.storage_protocol = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.target_helper = lioadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.target_ip_address = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.target_port = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.trace_flags = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.use_chap_auth = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_clear = zero {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_clear_size = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] lvmdriver-1.volumes_dir = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.ssl = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_notifications.driver = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_notifications.retry = -1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] key_manager.fixed_key = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.barbican_api_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.barbican_endpoint = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.barbican_endpoint_type = public {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.barbican_region_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.cafile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.collect_timing = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.insecure = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.number_of_retries = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.retry_delay = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.send_service_user_token = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.split_loggers = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.timeout = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.tls_ciphers = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.tls_min_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.verify_ssl = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican.verify_ssl_path = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.auth_section = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.auth_type = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.cafile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.collect_timing = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.insecure = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.split_loggers = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.timeout = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.tls_ciphers = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] barbican_service_user.tls_min_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.approle_role_id = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.approle_secret_id = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.auth_method = approle {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.auth_path = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.kv_mountpoint = secret {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.kv_path = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.kv_version = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.namespace = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.root_token_id = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.ssl_ca_crt_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.timeout = 60.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.token_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.token_role = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.use_ssl = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:40:51 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] ******************************************************************************** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 17:40:52 devstack sudo[76429]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:52 devstack sudo[76437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:52 devstack sudo[76437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:52 devstack sudo[76437]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.319s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:40:52 devstack cinder-volume[76425]: INFO cinder.brick.local_dev.lvm [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:52 devstack sudo[76502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:40:52 devstack sudo[76502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:52 devstack sudo[76502]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG cinder.brick.local_dev.lvm [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76425) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 09 17:40:52 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:52 devstack sudo[76627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:52 devstack sudo[76627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:53 devstack sudo[76627]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.516s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:53 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:53 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:53 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:53 devstack sudo[76905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 09 17:40:53 devstack sudo[76905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:53 devstack sudo[76905]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.291s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:53 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:53 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:40:53 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:54 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:54 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:54 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:54 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:40:54 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:54 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:54 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:54 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:54 devstack sudo[77119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:40:54 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:54 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:54 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:54 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:54 devstack sudo[77134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:54 devstack sudo[77134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:55 devstack sudo[77134]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:55 devstack sudo[77144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:55 devstack sudo[77144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:55 devstack sudo[77144]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:55 devstack cinder-volume[76425]: INFO cinder.volume.drivers.lvm [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:55 devstack sudo[77228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:55 devstack sudo[77228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:55 devstack sudo[77228]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG cinder.volume.drivers.lvm [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Updating volume stats {{(pid=76425) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:55 devstack sudo[77237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:40:55 devstack sudo[77237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:55 devstack sudo[77237]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:55 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:55 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:40:55 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:56 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:56 devstack sudo[77243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:56 devstack sudo[77243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:56 devstack sudo[77243]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:56 devstack sudo[77246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:40:56 devstack sudo[77246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:56 devstack sudo[77246]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:56 devstack cinder-volume[76425]: INFO cinder.volume.driver [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG cinder.volume.driver [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76425) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG oslo_db.sqlalchemy.engines [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG dbcounter [-] [76425] Writer thread running {{(pid=76425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG cinder.db.api [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Building query based on filter {{(pid=76425) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG cinder.image.image_utils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76425) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 17:40:56 devstack cinder-volume[76425]: INFO cinder.keymgr.migration [None req-abd81700-fe5a-4d42-85d9-2c26c7b1b1f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG cinder.volume.drivers.lvm [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Updating volume stats {{(pid=76425) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 17:40:56 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:56 devstack sudo[77250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:40:56 devstack sudo[77250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:57 devstack sudo[77250]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:57 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:57 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:57 devstack sudo[77253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:40:57 devstack sudo[77253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:57 devstack sudo[77253]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:57 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:57 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:57 devstack sudo[77256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:57 devstack sudo[77256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:57 devstack sudo[77256]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:57 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:57 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:57 devstack sudo[77262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:40:57 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:57 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:57 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:57 devstack cinder-volume[76425]: DEBUG cinder.manager [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Notifying Schedulers of capabilities ... {{(pid=76425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:40:58 devstack cinder-volume[76425]: INFO cinder.volume.manager [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Driver initialization completed successfully. Sep 09 17:40:58 devstack cinder-volume[76425]: INFO cinder.manager [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Initiating service 2 cleanup Sep 09 17:40:58 devstack cinder-volume[76425]: INFO cinder.manager [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Service 2 cleanup completed. Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG cinder.service [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Creating RPC server for service cinder-volume {{(pid=76425) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG cinder.service [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76425) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 17:40:58 devstack cinder-volume[76425]: INFO cinder.volume.manager [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG cinder.volume.drivers.lvm [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Updating volume stats {{(pid=76425) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:58 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:40:58 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:58 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:58 devstack sudo[77268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:40:58 devstack sudo[77268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:58 devstack sudo[77268]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:58 devstack sudo[77274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:40:58 devstack sudo[77274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:58 devstack sudo[77274]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:58 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:40:59 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:40:59 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:40:59 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Sep 09 17:40:59 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:40:59 devstack cinder-volume[76425]: INFO cinder.volume.manager [None req-b0a3aed6-6240-497e-8a13-f09fbdeed8b6 None None] Driver post RPC initialization completed successfully. Sep 09 17:41:01 devstack cinder-volume[76270]: DEBUG dbcounter [-] [76270] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:41:08 devstack cinder-volume[76425]: DEBUG dbcounter [-] [76425] Writing DB stats cinder:SELECT=2 {{(pid=76425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:41:09 devstack cinder-volume[76425]: DEBUG dbcounter [-] [76425] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:41:31 devstack cinder-volume[76425]: DEBUG oslo_service.periodic_task [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running periodic task VolumeManager._thread_info {{(pid=76425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:41:31 devstack cinder-volume[76425]: DEBUG cinder.volume.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] thread count: 6 {{(pid=76425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:41:31 devstack cinder-volume[76425]: DEBUG cinder.volume.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] thread info: [<_MainThread(MainThread, started 139580291555456)>, , , , , ] {{(pid=76425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:42:31 devstack cinder-volume[76425]: DEBUG oslo_service.periodic_task [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:42:31 devstack cinder-volume[76425]: DEBUG cinder.volume.drivers.lvm [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Updating volume stats {{(pid=76425) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 17:42:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:42:31 devstack sudo[82400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:42:31 devstack sudo[82400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:42:31 devstack sudo[82400]: pam_unix(sudo:session): session closed for user root Sep 09 17:42:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:42:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:42:31 devstack sudo[82442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:42:31 devstack sudo[82442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:42:31 devstack sudo[82442]: pam_unix(sudo:session): session closed for user root Sep 09 17:42:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:42:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:42:31 devstack sudo[82445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:42:31 devstack sudo[82445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:42:32 devstack sudo[82445]: pam_unix(sudo:session): session closed for user root Sep 09 17:42:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:42:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:42:32 devstack sudo[82449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:42:32 devstack sudo[82449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:42:32 devstack sudo[82449]: pam_unix(sudo:session): session closed for user root Sep 09 17:42:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:42:32 devstack cinder-volume[76425]: DEBUG cinder.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Notifying Schedulers of capabilities ... {{(pid=76425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:42:32 devstack cinder-volume[76425]: DEBUG oslo_service.periodic_task [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running periodic task VolumeManager._thread_info {{(pid=76425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:42:32 devstack cinder-volume[76425]: DEBUG cinder.volume.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] thread count: 6 {{(pid=76425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:42:32 devstack cinder-volume[76425]: DEBUG cinder.volume.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] thread info: [<_MainThread(MainThread, started 139580291555456)>, , , , , ] {{(pid=76425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:43:09 devstack cinder-volume[76425]: DEBUG dbcounter [-] [76425] Writing DB stats cinder:SELECT=1 {{(pid=76425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:43:09 devstack cinder-volume[76425]: DEBUG dbcounter [-] [76425] Writing DB stats cinder:UPDATE=1 {{(pid=76425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:43:31 devstack cinder-volume[76425]: DEBUG oslo_service.periodic_task [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:43:31 devstack cinder-volume[76425]: DEBUG cinder.volume.drivers.lvm [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Updating volume stats {{(pid=76425) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 17:43:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:43:31 devstack sudo[83882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:43:31 devstack sudo[83882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:43:31 devstack sudo[83882]: pam_unix(sudo:session): session closed for user root Sep 09 17:43:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:43:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:43:31 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:43:31 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:43:31 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Sep 09 17:43:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:43:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:43:31 devstack sudo[83904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:43:31 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:43:32 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root Sep 09 17:43:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:43:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:43:32 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:43:32 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:43:32 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Sep 09 17:43:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:43:32 devstack cinder-volume[76425]: DEBUG cinder.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Notifying Schedulers of capabilities ... {{(pid=76425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:43:32 devstack cinder-volume[76425]: DEBUG oslo_service.periodic_task [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running periodic task VolumeManager._thread_info {{(pid=76425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:43:32 devstack cinder-volume[76425]: DEBUG cinder.volume.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] thread count: 6 {{(pid=76425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:43:32 devstack cinder-volume[76425]: DEBUG cinder.volume.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] thread info: [<_MainThread(MainThread, started 139580291555456)>, , , , , ] {{(pid=76425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:44:31 devstack cinder-volume[76425]: DEBUG oslo_service.periodic_task [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:44:31 devstack cinder-volume[76425]: DEBUG cinder.volume.drivers.lvm [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Updating volume stats {{(pid=76425) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 17:44:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:44:31 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 17:44:31 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:44:31 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Sep 09 17:44:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:44:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:44:31 devstack sudo[85390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:44:31 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:44:31 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root Sep 09 17:44:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:44:31 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:44:31 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 17:44:31 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:44:32 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Sep 09 17:44:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:44:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:44:32 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 17:44:32 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:44:32 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Sep 09 17:44:32 devstack cinder-volume[76425]: DEBUG oslo_concurrency.processutils [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:44:32 devstack cinder-volume[76425]: DEBUG cinder.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Notifying Schedulers of capabilities ... {{(pid=76425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:44:32 devstack cinder-volume[76425]: DEBUG oslo_service.periodic_task [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] Running periodic task VolumeManager._thread_info {{(pid=76425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:44:32 devstack cinder-volume[76425]: DEBUG cinder.volume.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] thread count: 6 {{(pid=76425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:44:32 devstack cinder-volume[76425]: DEBUG cinder.volume.manager [None req-d2da33a7-1c20-44e6-b09f-b2a309fefb3b None None] thread info: [<_MainThread(MainThread, started 139580291555456)>, , , , , ] {{(pid=76425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:45:09 devstack cinder-volume[76425]: DEBUG dbcounter [-] [76425] Writing DB stats cinder:SELECT=1 {{(pid=76425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:45:09 devstack cinder-volume[76425]: DEBUG dbcounter [-] [76425] Writing DB stats cinder:UPDATE=1 {{(pid=76425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:45:17 devstack cinder-volume[76270]: INFO oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Caught SIGTERM, stopping children Sep 09 17:45:17 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Acquiring lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 17:45:17 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Acquired lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 17:45:17 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Releasing lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 17:45:17 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Stop services. {{(pid=76270) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 17:45:17 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Killing children. {{(pid=76270) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 17:45:17 devstack cinder-volume[76270]: INFO oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Waiting on 1 children to exit Sep 09 17:45:18 devstack cinder-volume[76425]: DEBUG oslo_concurrency.lockutils [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Acquiring lock "singleton_lock" {{(pid=76425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 17:45:18 devstack cinder-volume[76425]: DEBUG oslo_concurrency.lockutils [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Acquired lock "singleton_lock" {{(pid=76425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 17:45:18 devstack cinder-volume[76425]: DEBUG oslo_concurrency.lockutils [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Releasing lock "singleton_lock" {{(pid=76425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 17:45:18 devstack cinder-volume[76425]: WARNING amqp [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 17:45:18 devstack cinder-volume[76425]: WARNING amqp [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 17:45:18 devstack cinder-volume[76270]: INFO oslo_service.backend._eventlet.service [None req-ac8f5db4-ed62-4f76-806c-4d2dc2e683a9 None None] Child 76425 exited with status 0 Sep 09 17:45:18 devstack cinder-volume[86406]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 17:45:18 devstack cinder-volume[86406]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 17:45:18 devstack cinder-volume[86406]: we strongly recommend against using it for new projects. Sep 09 17:45:18 devstack cinder-volume[86406]: If you are already using Eventlet, we recommend migrating to a different Sep 09 17:45:18 devstack cinder-volume[86406]: framework. For more detail see Sep 09 17:45:18 devstack cinder-volume[86406]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 17:45:18 devstack cinder-volume[86406]: import eventlet # noqa Sep 09 17:45:20 devstack cinder-volume[86406]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 17:45:20 devstack cinder-volume[86406]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 17:45:20 devstack cinder-volume[86406]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 17:45:21 devstack cinder-volume[86406]: INFO dbcounter [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Registered counter for database cinder Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_db.sqlalchemy.engines [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG dbcounter [-] [86406] Writer thread running {{(pid=86406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 17:45:21 devstack cinder-volume[86406]: INFO cinder.rpc [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 17:45:21 devstack cinder-volume[86406]: INFO cinder.rpc [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_db.sqlalchemy.engines [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:45:21 devstack cinder-volume[86406]: INFO cinder.volume.manager [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Determined volume DB was empty at startup. Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG cinder.volume.manager [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86406) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 17:45:21 devstack cinder-volume[86406]: INFO cinder.volume.manager [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 17:45:21 devstack cinder-volume[86406]: WARNING stevedore.named [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 17:45:21 devstack cinder-volume[86406]: WARNING castellan.key_manager [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 17:45:21 devstack cinder-volume[86406]: WARNING cinder.keymgr.conf_key_mgr [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 17:45:21 devstack cinder-volume[86406]: INFO cinder.volume.manager [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_db.sqlalchemy.engines [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:45:21 devstack cinder-volume[86406]: INFO oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Starting 1 workers Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Started child 86621 {{(pid=86406) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Full set of CONF: {{(pid=86406) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] ******************************************************************************** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Configuration options gathered from: {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] ================================================================================ {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] allow_availability_zone_fallback = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86621]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] allow_compression_on_image_upload = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] allowed_direct_url_schemes = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] api_rate_limit = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] auth_strategy = keystone {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_availability_zone = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_host = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_stats_polling_interval = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backup_api_class = cinder.backup.api.API {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backup_name_template = backup-%s {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backup_use_same_host = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backup_use_temp_snapshot = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] chap_password = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] chap_username = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_internal_tenant_project_id = 07bf2dbcb33b4b33adf57900c6afb124 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_internal_tenant_user_id = b050c61da0aa4cb5ae6ead63f534aee4 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cluster = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] compression_format = gzip {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] compute_api_class = cinder.compute.nova.API {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] config_dir = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] config_source = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] control_exchange = openstack {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] debug = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] default_availability_zone = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] default_group_type = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] default_volume_type = QuobyteHD {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] disk_geometry = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] driver_client_cert = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] driver_client_cert_key = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] driver_data_namespace = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] driver_ssl_cert_path = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] driver_ssl_cert_verify = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] driver_use_ssl = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] enable_new_services = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] enable_unsupported_driver = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] enabled_backends = ['QuobyteHD'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] enforce_multipath_for_image_xfer = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] filter_function = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_api_insecure = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_api_ssl_compression = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_ca_certificates_file = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_catalog_info = image:glance:publicURL {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_certfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_keyfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_num_retries = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance_request_timeout = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] goodness_function = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] graceful_shutdown_timeout = 5 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] group_api_class = cinder.group.api.API {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] host = devstack {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_compress_on_upload = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_conversion_address_space_limit = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_conversion_cpu_limit = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_conversion_disable = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_upload_use_cinder_backend = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_upload_use_internal_tenant = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_volume_cache_enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_volume_cache_max_count = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] image_volume_cache_max_size_gb = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] init_host_max_objects_retrieval = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] instance_format = [instance: %(uuid)s] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] iscsi_target_flags = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] iscsi_write_cache = on {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] iser_helper = tgtadm {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] iser_ip_address = 192.168.122.96 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 17:45:21 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.remotefs [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86621) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] iser_port = 3260 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_color = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_config_append = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_dir = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_file = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_options = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_rotate_interval = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_rotate_interval_type = days {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] log_rotation_type = none {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] max_age = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] max_logfile_count = 30 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] max_logfile_size_mb = 200 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] max_over_subscription_ratio = 20.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] message_reap_interval = 86400 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] message_ttl = 2592000 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] migration_create_volume_timeout_secs = 300 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] monkey_patch = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] monkey_patch_modules = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] my_ip = 192.168.122.96 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] no_snapshot_gb_quota = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] num_iser_scan_tries = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] num_shell_tries = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] num_volume_device_scan_tries = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] nvmeof_conn_info_version = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] nvmet_ns_id = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] nvmet_port_id = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] osapi_max_limit = 1000 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] osapi_volume_ext_list = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] osapi_volume_listen_port = 8776 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:21 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] osapi_volume_use_ssl = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] osapi_volume_workers = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] per_volume_size_limit = -1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] periodic_fuzzy_delay = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] periodic_interval = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] public_endpoint = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] publish_errors = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] quota_backup_gigabytes = 1000 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] quota_backups = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] quota_gigabytes = 1000 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] quota_groups = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] quota_snapshots = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] quota_volumes = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] rate_limit_burst = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] rate_limit_except_level = CRITICAL {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] rate_limit_interval = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] reinit_driver_count = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] replication_device = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] report_discard_supported = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] report_interval = 120 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] reservation_clean_interval = 86400 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] reservation_expire = 86400 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] reserved_image_namespaces = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] reserved_percentage = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] rpc_response_timeout = 120 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] run_external_periodic_tasks = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] scst_target_driver = iscsi {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] scst_target_iqn_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_down_time = 720 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] shell_completion = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] snapshot_name_template = snapshot-%s {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] split_loggers = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] state_path = /opt/stack/data/cinder {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] storage_availability_zone = nova {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] storage_protocol = iSCSI {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] syslog_log_facility = LOG_USER {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] target_helper = lioadm {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] target_ip_address = 192.168.122.96 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] target_port = 3260 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] target_protocol = iscsi {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] target_secondary_ip_addresses = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] trace_flags = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] transport_url = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] until_refresh = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] use_chap_auth = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] use_default_quota_class = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] use_journal = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] use_json = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] use_multipath_for_image_xfer = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] use_stderr = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] use_syslog = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] verify_glance_signatures = enabled {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_api_class = cinder.volume.api.API {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_backend_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_clear = zero {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_clear_ionice = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_clear_size = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_copy_bps_limit = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_dd_blocksize = 1M {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_name_template = volume-%s {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_service_inithost_offload = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volume_usage_audit_period = month {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] zoning_mode = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_concurrency.disable_process_locking = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86621) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 17:45:22 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 17:45:22 devstack cinder-volume[86621]: WARNING cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Running cmd (subprocess): mount.quobyte {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.auth_section = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.auth_type = password {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.auth_version = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.cache = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.certfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.include_service_catalog = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.insecure = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.interface = public {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.keyfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_password = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcache_username = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.region_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.service_type = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.backend = dogpile.cache.null {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.backend_argument = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.backend_expiration_time = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.config_prefix = cache.oslo {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.debug_cache_backend = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.enable_retry_client = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.enable_socket_keepalive = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.expiration_time = 600 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.hashclient_retry_attempts = 2 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.memcache_dead_retry = 300 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.memcache_pool_maxsize = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.memcache_sasl_enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.password = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.proxies = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.redis_db = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.redis_server = localhost:6379 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.retry_attempts = 2 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.retry_delay = 0.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.socket_keepalive_count = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.socket_keepalive_idle = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.socket_keepalive_interval = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.socket_timeout = 1.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.tls_allowed_ciphers = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.tls_cafile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.tls_certfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.tls_enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.tls_keyfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cache.username = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] coordination.backend_url = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.asyncio_connection = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.asyncio_slave_connection = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.backend = sqlalchemy {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.connection = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.connection_debug = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.connection_parameters = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.connection_recycle_time = 3600 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.connection_trace = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.db_inc_retry_interval = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.db_max_retries = 20 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.db_max_retry_interval = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.db_retry_interval = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.max_overflow = 50 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.max_pool_size = 5 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.max_retries = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.mysql_wsrep_sync_wait = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.pool_timeout = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.retry_interval = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.slave_connection = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.sqlite_synchronous = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.synchronous_reader = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] database.use_db_reconnect = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_tracing.insecure = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.connection_string = messaging:// {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.es_doc_type = notification {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.es_scroll_size = 10000 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.es_scroll_time = 2m {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.filter_error_trace = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.hmac_keys = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.sentinel_service_name = mymaster {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.socket_timeout = 0.1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.trace_requests = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler.trace_sqlalchemy = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler_jaeger.process_tags = {} {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler_jaeger.service_name_prefix = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] profiler_otlp.service_name_prefix = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.enforce_new_defaults = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.policy_default_rule = default {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.policy_file = policy.yaml {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] privsep_osbrick.group = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] privsep_osbrick.helper_command = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] privsep_osbrick.user = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_sys_admin.group = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_sys_admin.helper_command = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] cinder_sys_admin.user = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.auth_section = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.auth_type = password {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.cafile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.certfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.collect_timing = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.insecure = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.keyfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.send_service_user_token = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.split_loggers = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.timeout = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.tls_ciphers = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] service_user.tls_min_version = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.auth_section = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.auth_type = password {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.certfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.collect_timing = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.insecure = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.keyfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.region_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.split_loggers = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.timeout = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.tls_ciphers = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack quobyte-client[86622]: Reading configuration file: /etc/quobyte/client.cfg Sep 09 17:45:22 devstack quobyte-client[86622]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] glance.tls_min_version = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.backend_availability_zone = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] CMD "mount.quobyte" returned: 1 in 0.138s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.chap_password = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.chap_username = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.disk_geometry = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.driver_client_cert = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.driver_client_cert_key = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.driver_data_namespace = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.driver_use_ssl = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86621]: INFO cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf ... Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.extra_capabilities = {} {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d -c /etc/quobyte/client-cinder.cfg {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.filter_function = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.goodness_function = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.iscsi_target_flags = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.iscsi_write_cache = on {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.iser_helper = tgtadm {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.iser_port = 3260 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_host = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_login = admin {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_mount_options = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_password = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_private_key = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_share_path = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.num_shell_tries = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.quobyte_volume_url = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.replication_device = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.report_discard_supported = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.reserved_percentage = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.target_helper = tgtadm {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.target_port = 3260 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.target_protocol = iscsi {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.trace_flags = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.unique_fqdn_network = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.use_chap_auth = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volume_backend_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volume_clear = zero {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volume_clear_ionice = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volume_clear_size = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_reports.file_event_handler = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_reports.log_dir = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.backend_availability_zone = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.backend_host = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.chap_password = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.chap_username = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.chiscsi_conf = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.disk_geometry = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.driver_client_cert = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.driver_data_namespace = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.driver_use_ssl = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.extra_capabilities = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.filter_function = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.goodness_function = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.iser_helper = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.iser_ip_address = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.iser_port = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.iser_target_prefix = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_host = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_login = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_mount_options = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d -c /etc/quobyte/client-cinder.cfg Sep 09 17:45:22 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_password = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_private_key = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_share_path = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_ssh_port = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.num_shell_tries = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.nvmet_port_id = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.replication_device = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.report_discard_supported = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.reserved_percentage = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.scst_target_driver = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.storage_protocol = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.target_helper = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.target_ip_address = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.target_port = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.target_prefix = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.target_protocol = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.trace_flags = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.use_chap_auth = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volume_clear = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volume_clear_size = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] QuobyteHD.volumes_dir = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.ssl = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_notifications.driver = [] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_notifications.retry = -1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] key_manager.fixed_key = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.barbican_api_version = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.barbican_endpoint = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.barbican_endpoint_type = public {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.barbican_region_name = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.cafile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.certfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.collect_timing = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.insecure = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.keyfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.number_of_retries = 60 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.retry_delay = 1 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.send_service_user_token = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.split_loggers = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.timeout = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.tls_ciphers = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.tls_min_version = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.verify_ssl = True {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican.verify_ssl_path = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.auth_section = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.auth_type = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.cafile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.certfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.collect_timing = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.insecure = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.keyfile = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.split_loggers = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.timeout = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.tls_ciphers = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] barbican_service_user.tls_min_version = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.approle_role_id = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.approle_secret_id = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.auth_method = approle {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.auth_path = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.kv_mountpoint = secret {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.kv_path = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.kv_version = 2 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.namespace = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.root_token_id = **** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.ssl_ca_crt_file = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.timeout = 60.0 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.token_file = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.token_role = None {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.use_ssl = False {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:22 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] ******************************************************************************** {{(pid=86406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 17:45:22 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.440s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:22 devstack cinder-volume[86621]: INFO cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf succeeded Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.458s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:22 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:45:22 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:45:22 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.268s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:22 devstack cinder-volume[86621]: INFO cinder.volume.driver [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Driver hasn't implemented _init_vendor_properties() Sep 09 17:45:22 devstack cinder-volume[86621]: DEBUG cinder.volume.driver [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.2673110961914, 'free_capacity_gb': 1773.2673110961914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86621) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_db.sqlalchemy.engines [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG dbcounter [-] [86621] Writer thread running {{(pid=86621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.db.api [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Building query based on filter {{(pid=86621) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.image.image_utils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86621) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 17:45:23 devstack cinder-volume[86621]: INFO cinder.keymgr.migration [None req-dc5a6e71-b3e2-4908-aead-a2c4fea6e61c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:23 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:45:23 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:45:23 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.272s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:45:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Driver initialization completed successfully. Sep 09 17:45:23 devstack cinder-volume[86621]: INFO cinder.manager [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Initiating service 3 cleanup Sep 09 17:45:23 devstack cinder-volume[86621]: INFO cinder.manager [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Service 3 cleanup completed. Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.service [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Creating RPC server for service cinder-volume {{(pid=86621) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.service [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86621) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 17:45:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:23 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:45:23 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:45:23 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Sep 09 17:45:23 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.265s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:23 devstack cinder-volume[86621]: INFO cinder.volume.manager [None req-10d45a4e-26f0-484f-8559-620bcef8041d None None] Driver post RPC initialization completed successfully. Sep 09 17:45:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-bf307f7a-9f9d-4034-9c9d-752cc329b714 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:45:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-bf307f7a-9f9d-4034-9c9d-752cc329b714 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:45:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-bf307f7a-9f9d-4034-9c9d-752cc329b714 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=86621) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:45:28 devstack cinder-volume[86621]: DEBUG cinder.volume.drivers.quobyte [None req-bf307f7a-9f9d-4034-9c9d-752cc329b714 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=86621) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:45:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-bf307f7a-9f9d-4034-9c9d-752cc329b714 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86621) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:45:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-bf307f7a-9f9d-4034-9c9d-752cc329b714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:28 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:45:28 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:45:28 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Sep 09 17:45:28 devstack cinder-volume[86621]: DEBUG oslo_concurrency.processutils [None req-bf307f7a-9f9d-4034-9c9d-752cc329b714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.230s {{(pid=86621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:28 devstack cinder-volume[86621]: DEBUG cinder.manager [None req-bf307f7a-9f9d-4034-9c9d-752cc329b714 None None] Notifying Schedulers of capabilities ... {{(pid=86621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:45:28 devstack cinder-volume[86406]: INFO oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Caught SIGTERM, stopping children Sep 09 17:45:28 devstack cinder-volume[86406]: DEBUG oslo_concurrency.lockutils [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Acquiring lock "singleton_lock" {{(pid=86406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 17:45:28 devstack cinder-volume[86406]: DEBUG oslo_concurrency.lockutils [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Acquired lock "singleton_lock" {{(pid=86406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 17:45:28 devstack cinder-volume[86406]: DEBUG oslo_concurrency.lockutils [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Releasing lock "singleton_lock" {{(pid=86406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 17:45:28 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Stop services. {{(pid=86406) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 17:45:28 devstack cinder-volume[86406]: DEBUG oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Killing children. {{(pid=86406) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 17:45:28 devstack cinder-volume[86406]: INFO oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Waiting on 1 children to exit Sep 09 17:45:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Acquiring lock "singleton_lock" {{(pid=86621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 17:45:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Acquired lock "singleton_lock" {{(pid=86621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 17:45:31 devstack cinder-volume[86621]: DEBUG oslo_concurrency.lockutils [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Releasing lock "singleton_lock" {{(pid=86621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 17:45:31 devstack cinder-volume[86621]: WARNING amqp [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 17:45:31 devstack cinder-volume[86621]: WARNING amqp [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 17:45:31 devstack cinder-volume[86406]: INFO oslo_service.backend._eventlet.service [None req-94b434dc-f44f-43d4-88bf-c5ecd4fed590 None None] Child 86621 exited with status 0 Sep 09 17:45:32 devstack cinder-volume[86903]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 17:45:32 devstack cinder-volume[86903]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 17:45:32 devstack cinder-volume[86903]: we strongly recommend against using it for new projects. Sep 09 17:45:32 devstack cinder-volume[86903]: If you are already using Eventlet, we recommend migrating to a different Sep 09 17:45:32 devstack cinder-volume[86903]: framework. For more detail see Sep 09 17:45:32 devstack cinder-volume[86903]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 17:45:32 devstack cinder-volume[86903]: import eventlet # noqa Sep 09 17:45:35 devstack cinder-volume[86903]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 17:45:35 devstack cinder-volume[86903]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 17:45:35 devstack cinder-volume[86903]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86903) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 17:45:36 devstack cinder-volume[86903]: INFO dbcounter [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Registered counter for database cinder Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_db.sqlalchemy.engines [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86903) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG dbcounter [-] [86903] Writer thread running {{(pid=86903) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 17:45:36 devstack cinder-volume[86903]: INFO cinder.rpc [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 17:45:36 devstack cinder-volume[86903]: INFO cinder.rpc [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_db.sqlalchemy.engines [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86903) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:45:36 devstack cinder-volume[86903]: INFO cinder.volume.manager [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Determined volume DB was empty at startup. Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG cinder.volume.manager [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86903) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 17:45:36 devstack cinder-volume[86903]: WARNING stevedore.named [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 17:45:36 devstack cinder-volume[86903]: WARNING castellan.key_manager [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 17:45:36 devstack cinder-volume[86903]: WARNING cinder.keymgr.conf_key_mgr [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 17:45:36 devstack cinder-volume[86903]: INFO cinder.volume.manager [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_db.sqlalchemy.engines [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86903) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:45:36 devstack cinder-volume[86903]: INFO oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Starting 1 workers Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Started child 87202 {{(pid=86903) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Full set of CONF: {{(pid=86903) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] ******************************************************************************** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] Configuration options gathered from: {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] ================================================================================ {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] allow_availability_zone_fallback = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] allow_compression_on_image_upload = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] allowed_direct_url_schemes = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] api_rate_limit = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] auth_strategy = keystone {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_availability_zone = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_host = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_stats_polling_interval = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backup_api_class = cinder.backup.api.API {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backup_name_template = backup-%s {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backup_use_same_host = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backup_use_temp_snapshot = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] chap_password = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[87202]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] chap_username = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_internal_tenant_project_id = 07bf2dbcb33b4b33adf57900c6afb124 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_internal_tenant_user_id = b050c61da0aa4cb5ae6ead63f534aee4 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cluster = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] compression_format = gzip {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] compute_api_class = cinder.compute.nova.API {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] config_dir = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] config_source = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] control_exchange = openstack {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] debug = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] default_availability_zone = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] default_group_type = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] default_volume_type = QuobyteHD {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] disk_geometry = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] driver_client_cert = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] driver_client_cert_key = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] driver_data_namespace = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] driver_ssl_cert_path = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] driver_ssl_cert_verify = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] driver_use_ssl = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] enable_new_services = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] enable_unsupported_driver = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] enabled_backends = ['QuobyteHD'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] enforce_multipath_for_image_xfer = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] filter_function = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_api_insecure = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_api_servers = ['http://192.168.122.96/image'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_api_ssl_compression = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_ca_certificates_file = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_catalog_info = image:glance:publicURL {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_certfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_keyfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_num_retries = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance_request_timeout = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] goodness_function = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] graceful_shutdown_timeout = 5 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] group_api_class = cinder.group.api.API {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] host = devstack {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_compress_on_upload = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_conversion_address_space_limit = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_conversion_cpu_limit = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_conversion_disable = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_upload_use_cinder_backend = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_upload_use_internal_tenant = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_volume_cache_enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_volume_cache_max_count = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] image_volume_cache_max_size_gb = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] init_host_max_objects_retrieval = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] instance_format = [instance: %(uuid)s] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] iscsi_target_flags = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] iscsi_write_cache = on {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] iser_helper = tgtadm {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] iser_ip_address = 192.168.122.96 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] iser_port = 3260 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_color = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_config_append = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_dir = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_file = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_options = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_rotate_interval = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_rotate_interval_type = days {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] log_rotation_type = none {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] max_age = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] max_logfile_count = 30 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] max_logfile_size_mb = 200 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] max_over_subscription_ratio = 20.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] message_reap_interval = 86400 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] message_ttl = 2592000 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] migration_create_volume_timeout_secs = 300 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] monkey_patch = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] monkey_patch_modules = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] my_ip = 192.168.122.96 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] no_snapshot_gb_quota = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] num_iser_scan_tries = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] num_shell_tries = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] num_volume_device_scan_tries = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] nvmeof_conn_info_version = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] nvmet_ns_id = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] nvmet_port_id = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] osapi_max_limit = 1000 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] osapi_volume_ext_list = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] osapi_volume_listen_port = 8776 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] osapi_volume_use_ssl = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] osapi_volume_workers = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] per_volume_size_limit = -1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] periodic_fuzzy_delay = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] periodic_interval = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] public_endpoint = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] publish_errors = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] quota_backup_gigabytes = 1000 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87202) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] quota_backups = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] quota_gigabytes = 1000 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] quota_groups = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] quota_snapshots = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] quota_volumes = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] rate_limit_burst = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] rate_limit_except_level = CRITICAL {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] rate_limit_interval = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] reinit_driver_count = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] replication_device = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] report_discard_supported = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] report_interval = 120 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] reservation_clean_interval = 86400 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] reservation_expire = 86400 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] reserved_image_namespaces = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] reserved_percentage = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] rpc_response_timeout = 120 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] run_external_periodic_tasks = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] scst_target_driver = iscsi {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] scst_target_iqn_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_down_time = 720 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] shell_completion = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] snapshot_name_template = snapshot-%s {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] split_loggers = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] state_path = /opt/stack/data/cinder {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] storage_availability_zone = nova {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] storage_protocol = iSCSI {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] syslog_log_facility = LOG_USER {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] target_helper = lioadm {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] target_ip_address = 192.168.122.96 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] target_port = 3260 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] target_protocol = iscsi {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] target_secondary_ip_addresses = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] trace_flags = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] transport_url = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] until_refresh = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] use_chap_auth = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] use_default_quota_class = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] use_journal = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] use_json = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] use_multipath_for_image_xfer = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] use_stderr = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] use_syslog = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] verify_glance_signatures = enabled {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_api_class = cinder.volume.api.API {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_backend_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_clear = zero {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_clear_ionice = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_clear_size = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_copy_bps_limit = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_dd_blocksize = 1M {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_name_template = volume-%s {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_service_inithost_offload = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volume_usage_audit_period = month {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] zoning_mode = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_concurrency.disable_process_locking = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.auth_section = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.auth_type = password {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.auth_version = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.cache = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.certfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.include_service_catalog = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.insecure = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.interface = public {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.keyfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_password = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcache_username = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.region_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.service_type = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.96/identity {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.backend = dogpile.cache.null {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.backend_argument = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.backend_expiration_time = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.config_prefix = cache.oslo {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.debug_cache_backend = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.enable_retry_client = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.enable_socket_keepalive = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.expiration_time = 600 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.hashclient_retry_attempts = 2 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.memcache_dead_retry = 300 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.memcache_pool_maxsize = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.memcache_sasl_enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.password = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.proxies = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.redis_db = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.redis_server = localhost:6379 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.retry_attempts = 2 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.retry_delay = 0.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.socket_keepalive_count = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.socket_keepalive_idle = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.socket_keepalive_interval = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.socket_timeout = 1.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.tls_allowed_ciphers = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87202) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.tls_cafile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.tls_certfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.tls_enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.tls_keyfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cache.username = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] coordination.backend_url = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.asyncio_connection = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.asyncio_slave_connection = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.backend = sqlalchemy {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.connection = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.connection_debug = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.connection_parameters = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.connection_recycle_time = 3600 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.connection_trace = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.db_inc_retry_interval = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.db_max_retries = 20 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.db_max_retry_interval = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.db_retry_interval = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.max_overflow = 50 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.max_pool_size = 5 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.max_retries = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Running cmd (subprocess): mount.quobyte {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.mysql_wsrep_sync_wait = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.pool_timeout = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.retry_interval = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.slave_connection = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.sqlite_synchronous = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.synchronous_reader = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] database.use_db_reconnect = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_tracing.insecure = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.connection_string = messaging:// {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.es_doc_type = notification {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.es_scroll_size = 10000 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.es_scroll_time = 2m {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.filter_error_trace = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.hmac_keys = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.sentinel_service_name = mymaster {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.socket_timeout = 0.1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.trace_requests = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler.trace_sqlalchemy = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler_jaeger.process_tags = {} {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler_jaeger.service_name_prefix = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] profiler_otlp.service_name_prefix = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.enforce_new_defaults = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.policy_default_rule = default {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.policy_file = policy.yaml {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] privsep_osbrick.group = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] privsep_osbrick.helper_command = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] privsep_osbrick.user = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_sys_admin.group = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_sys_admin.helper_command = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] cinder_sys_admin.user = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.auth_section = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.auth_type = password {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.cafile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.certfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.collect_timing = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.insecure = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.keyfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.send_service_user_token = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.split_loggers = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.timeout = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.tls_ciphers = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] service_user.tls_min_version = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.auth_section = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.auth_type = password {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.certfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.collect_timing = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.insecure = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.keyfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.region_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.split_loggers = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.timeout = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.tls_ciphers = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] glance.tls_min_version = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.backend_availability_zone = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.chap_password = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.chap_username = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.disk_geometry = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.driver_client_cert = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.driver_client_cert_key = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.driver_data_namespace = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.driver_use_ssl = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.extra_capabilities = {} {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.filter_function = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.goodness_function = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.iscsi_target_flags = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.iscsi_write_cache = on {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.iser_helper = tgtadm {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.iser_ip_address = 192.168.122.96 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.iser_port = 3260 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_host = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_login = admin {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_mount_options = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_password = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_private_key = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_share_path = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.num_shell_tries = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] CMD "mount.quobyte" returned: 1 in 0.046s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.quobyte_volume_url = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.replication_device = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.report_discard_supported = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.reserved_percentage = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.target_helper = tgtadm {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.target_ip_address = 192.168.122.96 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.target_port = 3260 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.target_protocol = iscsi {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.trace_flags = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.unique_fqdn_network = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:45:37 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.use_chap_auth = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volume_backend_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volume_clear = zero {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volume_clear_ionice = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volume_clear_size = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_reports.file_event_handler = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_reports.log_dir = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.backend_availability_zone = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.backend_host = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.chap_password = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.chap_username = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.chiscsi_conf = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.disk_geometry = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.driver_client_cert = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.driver_data_namespace = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.driver_use_ssl = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.extra_capabilities = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.filter_function = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.goodness_function = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.iser_helper = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.iser_ip_address = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.iser_port = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.iser_target_prefix = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_host = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_login = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_mount_options = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_password = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_private_key = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_share_path = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_ssh_port = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.num_shell_tries = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.nvmet_port_id = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.replication_device = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.report_discard_supported = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.reserved_percentage = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.scst_target_driver = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.storage_protocol = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.target_helper = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.target_ip_address = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.target_port = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.target_prefix = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.target_protocol = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.trace_flags = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.use_chap_auth = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volume_clear = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volume_clear_size = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] QuobyteHD.volumes_dir = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.ssl = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_notifications.driver = [] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_notifications.retry = -1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] key_manager.fixed_key = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.barbican_api_version = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.barbican_endpoint = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.barbican_endpoint_type = public {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.barbican_region_name = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.cafile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.certfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.collect_timing = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.insecure = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.keyfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.number_of_retries = 60 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.retry_delay = 1 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.send_service_user_token = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.split_loggers = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.timeout = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.tls_ciphers = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.tls_min_version = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.verify_ssl = True {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican.verify_ssl_path = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.auth_section = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.auth_type = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.cafile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.certfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.collect_timing = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.insecure = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.keyfile = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.split_loggers = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.timeout = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.tls_ciphers = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] barbican_service_user.tls_min_version = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.approle_role_id = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.approle_secret_id = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.auth_method = approle {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.auth_path = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.kv_mountpoint = secret {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.kv_path = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.kv_version = 2 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.namespace = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.root_token_id = **** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.ssl_ca_crt_file = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.timeout = 60.0 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.token_file = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.token_role = None {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.use_ssl = False {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 17:45:37 devstack cinder-volume[86903]: DEBUG oslo_service.backend._eventlet.service [None req-4599a5a9-40be-4c3b-becf-d5c6b53df523 None None] ******************************************************************************** {{(pid=86903) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 17:45:37 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:37 devstack cinder-volume[87202]: INFO cinder.volume.driver [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.volume.driver [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3011779785156, 'free_capacity_gb': 1773.3011779785156, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87202) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_db.sqlalchemy.engines [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writer thread running {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.db.api [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Building query based on filter {{(pid=87202) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87202) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:37 devstack cinder-volume[87202]: INFO cinder.keymgr.migration [None req-1d2a746d-9200-4cef-85eb-377ce4dba2c0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 17:45:37 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:45:37 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:45:37 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.233s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:45:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Driver initialization completed successfully. Sep 09 17:45:37 devstack cinder-volume[87202]: INFO cinder.manager [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Initiating service 3 cleanup Sep 09 17:45:37 devstack cinder-volume[87202]: INFO cinder.manager [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Service 3 cleanup completed. Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.service [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Creating RPC server for service cinder-volume {{(pid=87202) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.service [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87202) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 17:45:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:45:37 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:45:37 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:45:37 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Sep 09 17:45:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.230s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:45:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-abff05c7-fa06-47b7-b8e8-06d984b8be39 None None] Driver post RPC initialization completed successfully. Sep 09 17:45:46 devstack cinder-volume[86903]: DEBUG dbcounter [-] [86903] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86903) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:45:47 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=3 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:45:47 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:46:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:46:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 6 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:46:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:46:50 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Flow 'volume_create_manager' (10cbddcc-e976-4320-9932-8d89d47e2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca35c41b-d7a1-4581-b288-f922097033b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca35c41b-d7a1-4581-b288-f922097033b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1046104189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31089c70-3c74-45b1-b54b-4448370671a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f078fc4a404c14b76f2943dd5c62f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:46:51Z,use_quota=True,user_id='2f9b82fcc318489399a88134ce1d51ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb3b2e6-da15-43e7-af40-f63691e1a32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb3b2e6-da15-43e7-af40-f63691e1a32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a88e9f-c885-497a-91d5-bee9997f1ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a88e9f-c885-497a-91d5-bee9997f1ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31089c70-3c74-45b1-b54b-4448370671a2', 'volume_name': 'volume-31089c70-3c74-45b1-b54b-4448370671a2', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6981446-77b8-40a4-8ee1-8a933738d3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6981446-77b8-40a4-8ee1-8a933738d3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f612c73-ac4a-4a5b-ae56-a6bca556b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:51 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Volume 31089c70-3c74-45b1-b54b-4448370671a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31089c70-3c74-45b1-b54b-4448370671a2', 'volume_size': 1} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1046104189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31089c70-3c74-45b1-b54b-4448370671a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f078fc4a404c14b76f2943dd5c62f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:46:51Z,use_quota=True,user_id='2f9b82fcc318489399a88134ce1d51ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Creating volume 31089c70-3c74-45b1-b54b-4448370671a2 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:46:51 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:46:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:46:51 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 1073741824 Sep 09 17:46:51 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:46:52 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Sep 09 17:46:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 1073741824" returned: 0 in 1.186s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:46:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:46:52 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 Sep 09 17:46:52 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:46:53 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Sep 09 17:46:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2" returned: 0 in 0.506s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:46:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:46:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:46:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f612c73-ac4a-4a5b-ae56-a6bca556b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31089c70-3c74-45b1-b54b-4448370671a2', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b567d38-d871-4e60-994b-49aebef97ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Volume volume-31089c70-3c74-45b1-b54b-4448370671a2 (31089c70-3c74-45b1-b54b-4448370671a2): created successfully Sep 09 17:46:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b567d38-d871-4e60-994b-49aebef97ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Flow 'volume_create_manager' (10cbddcc-e976-4320-9932-8d89d47e2c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:46:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-155f90d9-1017-4491-b661-b55a89d70d9f tempest-DeleteServersTestJSON-1620589122 None] Created volume successfully. Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Flow 'volume_create_manager' (135016d7-eb5f-4ca8-b60b-c7bccb7bb590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe7f4ff-9681-41e1-a89b-2994cdda7fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe7f4ff-9681-41e1-a89b-2994cdda7fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-191067538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc131941-48cb-466a-af9e-084407c3e3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45801f48916c48c0ad9b493368e0760e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:46:54Z,use_quota=True,user_id='d4137c45cd464565beefff8f12c047bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c136e1f1-3489-4d38-b3bc-97091f7aab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c136e1f1-3489-4d38-b3bc-97091f7aab9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f69d7ec-7f93-4244-b130-7ad6dc8dd85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f69d7ec-7f93-4244-b130-7ad6dc8dd85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc131941-48cb-466a-af9e-084407c3e3f1', 'volume_name': 'volume-bc131941-48cb-466a-af9e-084407c3e3f1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a1a9c0-39b0-4645-8a47-60d5caeee5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a1a9c0-39b0-4645-8a47-60d5caeee5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41df927b-b408-4f0f-ab47-8c1d47081013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:54 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Volume bc131941-48cb-466a-af9e-084407c3e3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc131941-48cb-466a-af9e-084407c3e3f1', 'volume_size': 1} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-191067538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc131941-48cb-466a-af9e-084407c3e3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45801f48916c48c0ad9b493368e0760e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:46:54Z,use_quota=True,user_id='d4137c45cd464565beefff8f12c047bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Creating volume bc131941-48cb-466a-af9e-084407c3e3f1 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:46:54 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:46:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:46:54 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 1073741824 Sep 09 17:46:54 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:46:55 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Sep 09 17:46:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 1073741824" returned: 0 in 1.042s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:46:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:46:55 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 Sep 09 17:46:55 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:46:56 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Sep 09 17:46:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1" returned: 0 in 0.446s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:46:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:46:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:46:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41df927b-b408-4f0f-ab47-8c1d47081013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc131941-48cb-466a-af9e-084407c3e3f1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28fbd08-7071-4e6b-9fc5-291022320dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:46:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Volume volume-bc131941-48cb-466a-af9e-084407c3e3f1 (bc131941-48cb-466a-af9e-084407c3e3f1): created successfully Sep 09 17:46:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28fbd08-7071-4e6b-9fc5-291022320dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:46:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Flow 'volume_create_manager' (135016d7-eb5f-4ca8-b60b-c7bccb7bb590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:46:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4a678e10-c3d9-4045-819b-0068a1e6f8c2 tempest-VolumesAdminNegativeTest-1709466291 None] Created volume successfully. Sep 09 17:46:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Acquiring lock "cinder-bc131941-48cb-466a-af9e-084407c3e3f1-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:46:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Lock "cinder-bc131941-48cb-466a-af9e-084407c3e3f1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:46:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Acquiring lock "cinder-quobyte-bc131941-48cb-466a-af9e-084407c3e3f1" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:46:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Lock "cinder-quobyte-bc131941-48cb-466a-af9e-084407c3e3f1" acquired by "delete_volume" :: waited 0.060s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:46:58 devstack cinder-volume[87202]: INFO oslo.privsep.daemon [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8m8njyl2/privsep.sock'] Sep 09 17:46:58 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8m8njyl2/privsep.sock Sep 09 17:46:58 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 17:47:00 devstack cinder-volume[87202]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 09 17:47:00 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:00 devstack cinder-volume[87202]: INFO oslo.privsep.daemon [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Spawned new privsep daemon via rootwrap Sep 09 17:47:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Accepted privsep connection to /tmp/tmp8m8njyl2/privsep.sock {{(pid=87202) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 09 17:47:00 devstack cinder-volume[87202]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 09 17:47:00 devstack cinder-volume[87202]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 09 17:47:00 devstack cinder-volume[87202]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 09 17:47:00 devstack cinder-volume[87202]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88402 Sep 09 17:47:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d423f51-af05-4c0f-9868-ab6af1955c9f]: (2,) {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:47:01 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0b23f1-0551-4f27-9ba2-a34aa7a3f84e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:47:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:01 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 Sep 09 17:47:01 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:01 devstack cinder-volume[87202]: WARNING py.warnings [req-cfe964ab-f6b5-4061-acef-a5f394139eb0 req-e2d2c458-f6c7-4ea7-be22-9f649b50a7f7 tempest-DeleteServersTestJSON-1620589122 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 09 17:47:01 devstack cinder-volume[87202]: .first() Sep 09 17:47:01 devstack cinder-volume[87202]: Sep 09 17:47:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-cfe964ab-f6b5-4061-acef-a5f394139eb0 req-e2d2c458-f6c7-4ea7-be22-9f649b50a7f7 tempest-DeleteServersTestJSON-1620589122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-cfe964ab-f6b5-4061-acef-a5f394139eb0 req-e2d2c458-f6c7-4ea7-be22-9f649b50a7f7 tempest-DeleteServersTestJSON-1620589122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-cfe964ab-f6b5-4061-acef-a5f394139eb0 req-e2d2c458-f6c7-4ea7-be22-9f649b50a7f7 tempest-DeleteServersTestJSON-1620589122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-cfe964ab-f6b5-4061-acef-a5f394139eb0 req-e2d2c458-f6c7-4ea7-be22-9f649b50a7f7 tempest-DeleteServersTestJSON-1620589122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-31089c70-3c74-45b1-b54b-4448370671a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bfcb58b8-6318-4004-ba86-100583478b36', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:47:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-cfe964ab-f6b5-4061-acef-a5f394139eb0 req-e2d2c458-f6c7-4ea7-be22-9f649b50a7f7 tempest-DeleteServersTestJSON-1620589122 None] attachment_update completed successfully. Sep 09 17:47:02 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1" returned: 0 in 1.108s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:02 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1 Sep 09 17:47:02 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:03 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bc131941-48cb-466a-af9e-084407c3e3f1" returned: 0 in 1.010s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Lock "cinder-quobyte-bc131941-48cb-466a-af9e-084407c3e3f1" released by "delete_volume" :: held 4.830s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:03 devstack cinder-volume[87202]: WARNING cinder.quota [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:47:03 devstack cinder-volume[87202]: WARNING cinder.quota [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:47:03 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Created reservations ['883e4518-226c-41fd-bc7d-7664e9c336cf', 'a61ae61d-c4ab-4c06-b506-325cc5c060fa', 'c0572a89-2008-4bde-8dcd-a92da71a3d93', '337739f3-42b9-4737-b711-cf9e53155808'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:04 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:47:04 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:05 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:47:05 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:05 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.907s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:47:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Deleted volume successfully. Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-40fb7739-cab7-41d6-9b23-5a11163e728f tempest-VolumesAdminNegativeTest-1709466291 None] Lock "cinder-bc131941-48cb-466a-af9e-084407c3e3f1-delete_volume" released by "delete_volume" :: held 6.975s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:05 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.610s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 8 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:47:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:47:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-ff96a1ae-1c0d-42af-932c-2e1514cdf872 req-b0fae16b-71f5-4725-91f0-611ffb9deabf tempest-DeleteServersTestJSON-1620589122 None] Terminate volume connection completed successfully. Sep 09 17:47:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-ff96a1ae-1c0d-42af-932c-2e1514cdf872 req-b0fae16b-71f5-4725-91f0-611ffb9deabf tempest-DeleteServersTestJSON-1620589122 None] Deleting attachment bfcb58b8-6318-4004-ba86-100583478b36. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:47:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Acquiring lock "cinder-31089c70-3c74-45b1-b54b-4448370671a2-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Lock "cinder-31089c70-3c74-45b1-b54b-4448370671a2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Acquiring lock "cinder-quobyte-31089c70-3c74-45b1-b54b-4448370671a2" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Lock "cinder-quobyte-31089c70-3c74-45b1-b54b-4448370671a2" acquired by "delete_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f40e05-f2bf-4293-bc35-3710b9fe749d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:14 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 Sep 09 17:47:14 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:14 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2" returned: 0 in 0.413s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:14 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2 Sep 09 17:47:14 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:14 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31089c70-3c74-45b1-b54b-4448370671a2" returned: 0 in 0.281s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Lock "cinder-quobyte-31089c70-3c74-45b1-b54b-4448370671a2" released by "delete_volume" :: held 0.753s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Created reservations ['8606f1b4-5e44-4f0b-90eb-9bb9e4dd73bb', '448bacc0-2f8b-40e9-a2d1-34793f2372d3', '08cfd93f-07c1-4919-9a89-995043c8e8f7', '2543c45c-1c63-4bf0-a495-c4ad67401965'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:15 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:47:15 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:15 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.240s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:15 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:47:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Deleted volume successfully. Sep 09 17:47:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-729a609c-1eed-4bfe-9d74-b88de9ae9d2d tempest-DeleteServersTestJSON-1620589122 None] Lock "cinder-31089c70-3c74-45b1-b54b-4448370671a2-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Flow 'volume_create_manager' (fab9b31e-7e85-4078-951e-c207b9241e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4ab296-d4c8-4221-b4ad-75421bd4577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4ab296-d4c8-4221-b4ad-75421bd4577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1717452577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61131770-9850-4986-a57c-f3cad1027f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a52651de11d462a9ef37429f183522f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:47:18Z,use_quota=True,user_id='6b25f0c56bc34f5c9ec567e3ed31092a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bba5c7c-259d-4bde-be42-ea475c7c3924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bba5c7c-259d-4bde-be42-ea475c7c3924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b8770d-041a-4a68-a5c9-79c6f63ceff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b8770d-041a-4a68-a5c9-79c6f63ceff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61131770-9850-4986-a57c-f3cad1027f3c', 'volume_name': 'volume-61131770-9850-4986-a57c-f3cad1027f3c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9336a4e-8dbf-4870-ab42-3126701184a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9336a4e-8dbf-4870-ab42-3126701184a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac95bbd2-8888-4c1a-af23-edbb55e5878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:17 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Volume 61131770-9850-4986-a57c-f3cad1027f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61131770-9850-4986-a57c-f3cad1027f3c', 'volume_size': 1} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1717452577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61131770-9850-4986-a57c-f3cad1027f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a52651de11d462a9ef37429f183522f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:47:18Z,use_quota=True,user_id='6b25f0c56bc34f5c9ec567e3ed31092a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Creating volume 61131770-9850-4986-a57c-f3cad1027f3c {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:47:17 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:47:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:17 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c 1073741824 Sep 09 17:47:17 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:18 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c 1073741824" returned: 0 in 0.446s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:18 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c Sep 09 17:47:18 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:18 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c" returned: 0 in 0.237s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac95bbd2-8888-4c1a-af23-edbb55e5878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61131770-9850-4986-a57c-f3cad1027f3c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e621cef-8237-4763-b139-43da0ec7e652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:18 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Volume volume-61131770-9850-4986-a57c-f3cad1027f3c (61131770-9850-4986-a57c-f3cad1027f3c): created successfully Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e621cef-8237-4763-b139-43da0ec7e652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Flow 'volume_create_manager' (fab9b31e-7e85-4078-951e-c207b9241e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:47:18 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d732287e-87cf-4d51-9d41-18280919bc8a tempest-ServersNegativeTestJSON-24998681 None] Created volume successfully. Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Flow 'volume_create_manager' (1c651a7a-f6ab-4ddb-acc7-0edda2268d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebfe3d8-7dad-4eea-b4bf-95c67c4fcd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebfe3d8-7dad-4eea-b4bf-95c67c4fcd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1260454966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb274dbd-6c07-4a0d-8f17-83277f15303d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a52651de11d462a9ef37429f183522f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:47:23Z,use_quota=True,user_id='6b25f0c56bc34f5c9ec567e3ed31092a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc6006d-9346-4d40-8f1f-1a118be67c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc6006d-9346-4d40-8f1f-1a118be67c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee753b4a-12f3-4fce-acf4-44e087927a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee753b4a-12f3-4fce-acf4-44e087927a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb274dbd-6c07-4a0d-8f17-83277f15303d', 'volume_name': 'volume-bb274dbd-6c07-4a0d-8f17-83277f15303d', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81baf0de-be4f-4a70-98b3-6e5b3a6728e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81baf0de-be4f-4a70-98b3-6e5b3a6728e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70410a6a-4883-4e5a-a85a-7783a4dbb3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:22 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Volume bb274dbd-6c07-4a0d-8f17-83277f15303d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb274dbd-6c07-4a0d-8f17-83277f15303d', 'volume_size': 1} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1260454966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb274dbd-6c07-4a0d-8f17-83277f15303d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a52651de11d462a9ef37429f183522f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:47:23Z,use_quota=True,user_id='6b25f0c56bc34f5c9ec567e3ed31092a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Creating volume bb274dbd-6c07-4a0d-8f17-83277f15303d {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:47:23 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:23 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d 1073741824 Sep 09 17:47:23 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:23 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d 1073741824" returned: 0 in 0.599s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:23 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d Sep 09 17:47:23 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:23 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70410a6a-4883-4e5a-a85a-7783a4dbb3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb274dbd-6c07-4a0d-8f17-83277f15303d', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feb5345-3dec-4dd6-a3d8-0d235ceaaecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:23 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Volume volume-bb274dbd-6c07-4a0d-8f17-83277f15303d (bb274dbd-6c07-4a0d-8f17-83277f15303d): created successfully Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0feb5345-3dec-4dd6-a3d8-0d235ceaaecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Flow 'volume_create_manager' (1c651a7a-f6ab-4ddb-acc7-0edda2268d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:47:23 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c49c36f7-02fa-453a-89e8-508e36223061 tempest-ServersNegativeTestJSON-24998681 None] Created volume successfully. Sep 09 17:47:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "cinder-bb274dbd-6c07-4a0d-8f17-83277f15303d-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:47:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Lock "cinder-bb274dbd-6c07-4a0d-8f17-83277f15303d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:47:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "cinder-quobyte-bb274dbd-6c07-4a0d-8f17-83277f15303d" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:47:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Lock "cinder-quobyte-bb274dbd-6c07-4a0d-8f17-83277f15303d" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:47:26 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f2c38-55f6-4f38-bc0c-ceaae2bb4a76]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:47:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:26 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d Sep 09 17:47:26 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:27 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:27 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d Sep 09 17:47:27 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:27 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bb274dbd-6c07-4a0d-8f17-83277f15303d" returned: 0 in 0.313s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Lock "cinder-quobyte-bb274dbd-6c07-4a0d-8f17-83277f15303d" released by "delete_volume" :: held 0.730s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Created reservations ['a67a64f0-4114-4e86-8161-1f1c401d9726', 'a455b559-632d-4f66-9eea-5bb7fa21f1ca', 'a83586c5-052e-4ac2-81a2-416be9228d97', '61322032-29ac-460b-b345-860de3df7ad3'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:27 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:47:27 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "cinder-61131770-9850-4986-a57c-f3cad1027f3c-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Lock "cinder-61131770-9850-4986-a57c-f3cad1027f3c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:47:27 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.264s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:47:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Deleted volume successfully. Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "cinder-quobyte-61131770-9850-4986-a57c-f3cad1027f3c" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Lock "cinder-quobyte-61131770-9850-4986-a57c-f3cad1027f3c" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:47:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f750a074-d127-4637-aea9-544d8e20dd87 tempest-ServersNegativeTestJSON-24998681 None] Lock "cinder-bb274dbd-6c07-4a0d-8f17-83277f15303d-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1b93d8-26f4-4e8f-948b-01ac6a6a9c06]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:28 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c Sep 09 17:47:28 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:28 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c" returned: 0 in 0.359s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:28 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c Sep 09 17:47:28 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:28 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-61131770-9850-4986-a57c-f3cad1027f3c" returned: 0 in 0.296s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Lock "cinder-quobyte-61131770-9850-4986-a57c-f3cad1027f3c" released by "delete_volume" :: held 0.702s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Created reservations ['1550e416-6e56-4170-9640-dfa5263e05cf', '5c5e7a55-bd19-44c8-a71d-4bba57f873f0', '887ee44b-99f5-4fee-bcbf-1b2b66f96e3f', 'f8e05972-90f3-4b40-9054-43dfc0d2b47b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:28 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:47:28 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:29 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.381s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:29 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:47:29 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Deleted volume successfully. Sep 09 17:47:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c6126398-ad86-4936-afe4-2e0124595f20 tempest-ServersNegativeTestJSON-24998681 None] Lock "cinder-61131770-9850-4986-a57c-f3cad1027f3c-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Flow 'volume_create_manager' (8da2af31-e668-4e67-bfeb-246dc748bb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f116ef-9009-472d-aa34-12ab78a65ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f116ef-9009-472d-aa34-12ab78a65ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-243180643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ae3e65-963e-456b-b001-7ec2aaadcc6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4793481e64384739a0aabc880c731c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:47:46Z,use_quota=True,user_id='9d66ab915d004da3aa069625b64b6ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcb4220-b93c-4881-acd8-7a6bbfec4307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcb4220-b93c-4881-acd8-7a6bbfec4307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88369da1-f4fb-479e-a24d-5eafcc013d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88369da1-f4fb-479e-a24d-5eafcc013d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ae3e65-963e-456b-b001-7ec2aaadcc6f', 'volume_name': 'volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a5f176-c1f4-461f-ad87-d3b04daeb563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a5f176-c1f4-461f-ad87-d3b04daeb563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520c8d28-407a-466e-be6d-6ed7ae08a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:45 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Volume 15ae3e65-963e-456b-b001-7ec2aaadcc6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f', 'volume_size': 1} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-243180643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ae3e65-963e-456b-b001-7ec2aaadcc6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4793481e64384739a0aabc880c731c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:47:46Z,use_quota=True,user_id='9d66ab915d004da3aa069625b64b6ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Creating volume 15ae3e65-963e-456b-b001-7ec2aaadcc6f {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:47:45 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:47:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:45 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f 1073741824 Sep 09 17:47:45 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:46 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f 1073741824" returned: 0 in 0.574s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:46 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f Sep 09 17:47:46 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:46 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f" returned: 0 in 0.308s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520c8d28-407a-466e-be6d-6ed7ae08a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4396e9-815f-4232-b16c-3ea4446b6dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Volume volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f (15ae3e65-963e-456b-b001-7ec2aaadcc6f): created successfully Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4396e9-815f-4232-b16c-3ea4446b6dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Flow 'volume_create_manager' (8da2af31-e668-4e67-bfeb-246dc748bb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:47:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-bd97cc16-e83f-47bd-b454-73783aaad0cf req-fbc27928-9a90-4f2c-82bd-a2b44fd41252 tempest-VolumesGetTestJSON-1384397698 None] Created volume successfully. Sep 09 17:47:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Acquiring lock "cinder-15ae3e65-963e-456b-b001-7ec2aaadcc6f-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:47:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Lock "cinder-15ae3e65-963e-456b-b001-7ec2aaadcc6f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:47:48 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=60,cinder:SELECT=37,cinder:DELETE=6,cinder:INSERT=9 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:47:48 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=40,cinder:INSERT=12,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:47:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Acquiring lock "cinder-quobyte-15ae3e65-963e-456b-b001-7ec2aaadcc6f" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:47:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Lock "cinder-quobyte-15ae3e65-963e-456b-b001-7ec2aaadcc6f" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:47:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[172c25eb-b52f-4025-a66a-b8cd73f8af68]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:47:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:49 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f Sep 09 17:47:49 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:49 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f" returned: 0 in 0.471s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:49 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f Sep 09 17:47:49 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:49 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-15ae3e65-963e-456b-b001-7ec2aaadcc6f" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Lock "cinder-quobyte-15ae3e65-963e-456b-b001-7ec2aaadcc6f" released by "delete_volume" :: held 0.764s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG cinder.quota [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Created reservations ['69b81749-00f6-44b1-80ea-ffe0649aeb0e', '02716827-7c10-42c3-ac8b-0f76cc049e09', 'bb2ea293-6f71-4925-a6f5-bce98d1e19dc', '1b696c0b-cb4e-4362-b61e-8caaa20400ec'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:49 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:47:49 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:50 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.288s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:50 devstack cinder-volume[87202]: DEBUG cinder.manager [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:47:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Deleted volume successfully. Sep 09 17:47:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-abf0feb1-0b46-4cf7-b8f6-84b3c40a8152 req-229cca04-0833-4bc5-bfd3-0772cc546301 tempest-VolumesGetTestJSON-1384397698 None] Lock "cinder-15ae3e65-963e-456b-b001-7ec2aaadcc6f-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Flow 'volume_create_manager' (edbc2660-36d4-448a-96e6-4b6c42bf79c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cad7435-359f-48b2-88f7-774e6a98916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cad7435-359f-48b2-88f7-774e6a98916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1747642154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ef1c3c-04a5-459e-baa9-f88c94fcddb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4915cfd3758e41e7ba4c314ec0b15112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:47:58Z,use_quota=True,user_id='1fa7adf71f8044738332e5c5531ef173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4554adc9-2bfb-432a-8f35-89244cff29bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4554adc9-2bfb-432a-8f35-89244cff29bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62668b24-a8ae-4049-919b-3d610338e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62668b24-a8ae-4049-919b-3d610338e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ef1c3c-04a5-459e-baa9-f88c94fcddb6', 'volume_name': 'volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38adf788-795d-446c-aa7f-932cb7c25827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38adf788-795d-446c-aa7f-932cb7c25827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0219d2b-9607-4ae4-a54d-95d17726c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:58 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Volume 10ef1c3c-04a5-459e-baa9-f88c94fcddb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6', 'volume_size': 1} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1747642154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ef1c3c-04a5-459e-baa9-f88c94fcddb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4915cfd3758e41e7ba4c314ec0b15112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:47:58Z,use_quota=True,user_id='1fa7adf71f8044738332e5c5531ef173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Creating volume 10ef1c3c-04a5-459e-baa9-f88c94fcddb6 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:47:58 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:47:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:58 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 1073741824 Sep 09 17:47:58 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:59 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 1073741824" returned: 0 in 0.832s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:47:59 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 Sep 09 17:47:59 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:47:59 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Sep 09 17:47:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6" returned: 0 in 0.494s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:47:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:47:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:47:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0219d2b-9607-4ae4-a54d-95d17726c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:47:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ffd8b6-4e2f-4d20-a6dc-6e09db55d936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:47:59 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Volume volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 (10ef1c3c-04a5-459e-baa9-f88c94fcddb6): created successfully Sep 09 17:47:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06ffd8b6-4e2f-4d20-a6dc-6e09db55d936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Flow 'volume_create_manager' (edbc2660-36d4-448a-96e6-4b6c42bf79c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d3808fc2-02f4-46ac-baf7-6a49aebcfcc8 tempest-TaggedAttachmentsTest-54691944 None] Created volume successfully. Sep 09 17:48:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:48:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:05 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:48:05 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:05 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.426s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:48:10 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:48:10 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Flow 'volume_create_manager' (be8a45bf-7a88-4264-b81f-ecd465624543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57aac70a-b390-4e63-abf6-001af31edfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57aac70a-b390-4e63-abf6-001af31edfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-429337753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3602eb5-35f8-4c1f-9044-6c87a19513f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca2ff2270d041b0b274ea5c627fe3ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:21Z,use_quota=True,user_id='3678d8ad67ca4b498ca9fe2b717dd8f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c40997c-173f-446f-9e9e-3a4b9c0764ac),volume_type_id=5c40997c-173f-446f-9e9e-3a4b9c0764ac)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19accb70-5786-4ab9-ae03-28173f0d0102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19accb70-5786-4ab9-ae03-28173f0d0102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ba397a-34fe-408b-ae4f-e7c77b7eb17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ba397a-34fe-408b-ae4f-e7c77b7eb17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3602eb5-35f8-4c1f-9044-6c87a19513f2', 'volume_name': 'volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683b1b55-7f36-4235-b6b3-34b3a8bbad37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683b1b55-7f36-4235-b6b3-34b3a8bbad37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41c6bcb-597f-4057-8a83-710af08185c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:20 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Volume a3602eb5-35f8-4c1f-9044-6c87a19513f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2', 'volume_size': 1} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-429337753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3602eb5-35f8-4c1f-9044-6c87a19513f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca2ff2270d041b0b274ea5c627fe3ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:21Z,use_quota=True,user_id='3678d8ad67ca4b498ca9fe2b717dd8f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c40997c-173f-446f-9e9e-3a4b9c0764ac),volume_type_id=5c40997c-173f-446f-9e9e-3a4b9c0764ac)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Creating volume a3602eb5-35f8-4c1f-9044-6c87a19513f2 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:48:20 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:48:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:21 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 1073741824 Sep 09 17:48:21 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:21 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 1073741824" returned: 0 in 0.704s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:21 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 Sep 09 17:48:21 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:22 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2" returned: 0 in 0.381s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:48:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41c6bcb-597f-4057-8a83-710af08185c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c845c908-8f25-4a46-9cf8-2a4f9ee719d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:22 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Volume volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 (a3602eb5-35f8-4c1f-9044-6c87a19513f2): created successfully Sep 09 17:48:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c845c908-8f25-4a46-9cf8-2a4f9ee719d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Flow 'volume_create_manager' (be8a45bf-7a88-4264-b81f-ecd465624543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a8c559ac-4286-4a28-96f9-ef441bd80bff tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Created volume successfully. Sep 09 17:48:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:24 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:48:24 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:24 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.445s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:24 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:48:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0906b291-b35e-4b96-b7e5-101a86817d31 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Retype volume completed successfully. Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Acquiring lock "cinder-a3602eb5-35f8-4c1f-9044-6c87a19513f2-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "cinder-a3602eb5-35f8-4c1f-9044-6c87a19513f2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Acquiring lock "cinder-quobyte-a3602eb5-35f8-4c1f-9044-6c87a19513f2" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "cinder-quobyte-a3602eb5-35f8-4c1f-9044-6c87a19513f2" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbfaaa5-6422-49f5-8326-1e5f94615306]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:25 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 Sep 09 17:48:25 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Flow 'volume_create_manager' (7cf94962-07fa-4f4b-bacd-04c7edfb0919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccda6807-f87f-4a5d-aa49-4ae6b9789590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccda6807-f87f-4a5d-aa49-4ae6b9789590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-901997964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17bc096-5f69-4426-8c5f-1173578870d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7dabc10b44d8c982a6c0a13d6ebf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:26Z,use_quota=True,user_id='9d08fde7d2534efaaa588ada180fbdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c87f892-c01e-4d20-ba77-26f8d488bc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c87f892-c01e-4d20-ba77-26f8d488bc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4352c29-7a22-4224-960c-b7d13a91df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4352c29-7a22-4224-960c-b7d13a91df81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17bc096-5f69-4426-8c5f-1173578870d1', 'volume_name': 'volume-d17bc096-5f69-4426-8c5f-1173578870d1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2e04bf-c10e-43c3-860c-1b765bd53263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2e04bf-c10e-43c3-860c-1b765bd53263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88b8b1d-c19e-4a14-8881-a460e06b8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:26 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Volume d17bc096-5f69-4426-8c5f-1173578870d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17bc096-5f69-4426-8c5f-1173578870d1', 'volume_size': 1} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-901997964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17bc096-5f69-4426-8c5f-1173578870d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7dabc10b44d8c982a6c0a13d6ebf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:26Z,use_quota=True,user_id='9d08fde7d2534efaaa588ada180fbdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Creating volume d17bc096-5f69-4426-8c5f-1173578870d1 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:48:26 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:26 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 1073741824 Sep 09 17:48:26 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:26 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2" returned: 0 in 0.632s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:26 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2 Sep 09 17:48:26 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:26 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3602eb5-35f8-4c1f-9044-6c87a19513f2" returned: 0 in 0.358s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "cinder-quobyte-a3602eb5-35f8-4c1f-9044-6c87a19513f2" released by "delete_volume" :: held 1.073s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:48:26 devstack cinder-volume[87202]: WARNING cinder.quota [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:48:26 devstack cinder-volume[87202]: WARNING cinder.quota [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Created reservations ['139013e9-7561-489a-88e6-3a5cab3fde26', '3fe018b8-a81f-4756-b557-77ec2de275da', 'b8ed3c10-5060-4ef3-b101-fb99ea43bf2d', '75111564-ec66-4eef-b367-72c6f9209b42'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:48:26 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 1073741824" returned: 0 in 0.893s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:27 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:48:27 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:27 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 Sep 09 17:48:27 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:27 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1" returned: 0 in 0.420s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:27 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88b8b1d-c19e-4a14-8881-a460e06b8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17bc096-5f69-4426-8c5f-1173578870d1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab974c0c-3365-484c-a57d-8dc3fd808a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.537s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:48:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Deleted volume successfully. Sep 09 17:48:27 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Volume volume-d17bc096-5f69-4426-8c5f-1173578870d1 (d17bc096-5f69-4426-8c5f-1173578870d1): created successfully Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab974c0c-3365-484c-a57d-8dc3fd808a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Flow 'volume_create_manager' (7cf94962-07fa-4f4b-bacd-04c7edfb0919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-28047715-2926-4c4f-9eea-4a040d17145f tempest-ServerActionsTestOtherA-1146837832 None] Created volume successfully. Sep 09 17:48:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7ad82da4-d12b-47be-9540-ec2db46b11e3 tempest-VolumeRetypeWithoutMigrationTest-639007036 None] Lock "cinder-a3602eb5-35f8-4c1f-9044-6c87a19513f2-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Flow 'volume_create_manager' (c226eb46-bc7a-43ff-a3b6-2430aaabbb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc4170e-6c80-4e29-9df0-44a753c03cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc4170e-6c80-4e29-9df0-44a753c03cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1442864405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d07f53-e0a5-4f09-b85d-a49c83529e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82ac55897dc48eb859d56c1f048b29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:37Z,use_quota=True,user_id='601bbdf60ce84473bb83640fd0ec6815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd782e3b-1258-40a7-b469-eb16c6c1c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd782e3b-1258-40a7-b469-eb16c6c1c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713db0ea-c2af-441e-9cca-94426b58e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713db0ea-c2af-441e-9cca-94426b58e604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d07f53-e0a5-4f09-b85d-a49c83529e5c', 'volume_name': 'volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daadfff-54a1-44df-9686-38f9b3f4836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daadfff-54a1-44df-9686-38f9b3f4836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c817214-4811-4aed-8eff-3e16da0ad5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Volume 31d07f53-e0a5-4f09-b85d-a49c83529e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c', 'volume_size': 1} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1442864405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d07f53-e0a5-4f09-b85d-a49c83529e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82ac55897dc48eb859d56c1f048b29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:37Z,use_quota=True,user_id='601bbdf60ce84473bb83640fd0ec6815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Creating volume 31d07f53-e0a5-4f09-b85d-a49c83529e5c {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:48:37 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:37 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c 1073741824 Sep 09 17:48:37 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:37 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c 1073741824" returned: 0 in 0.496s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:37 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c Sep 09 17:48:37 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:37 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c" returned: 0 in 0.257s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c817214-4811-4aed-8eff-3e16da0ad5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb72a6f-d57d-4dab-a031-3b87a38ab50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Volume volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c (31d07f53-e0a5-4f09-b85d-a49c83529e5c): created successfully Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb72a6f-d57d-4dab-a031-3b87a38ab50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Flow 'volume_create_manager' (c226eb46-bc7a-43ff-a3b6-2430aaabbb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-41d3ec92-4dd1-49e7-8c35-cab23ea57255 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Created volume successfully. Sep 09 17:48:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Creating offline snapshot c68c25d8-e202-4c58-bd5a-1443b23d3d62 of volume 31d07f53-e0a5-4f09-b85d-a49c83529e5c {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:48:38 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a80ef48-f2e9-4fed-877c-776674e40319]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:48:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:38 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c Sep 09 17:48:38 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:38 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c" returned: 0 in 0.374s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:38 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 1G Sep 09 17:48:38 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:39 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 1G" returned: 0 in 0.397s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:39 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 Sep 09 17:48:39 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:39 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62" returned: 0 in 0.390s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:39 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 is being set with open permissions: ugo+rw Sep 09 17:48:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:39 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 Sep 09 17:48:39 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:39 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:39 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.info Sep 09 17:48:39 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:40 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.info" returned: 0 in 0.279s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:40 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.info is being set with open permissions: ugo+rw Sep 09 17:48:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:40 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.info Sep 09 17:48:40 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:40 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.info" returned: 0 in 0.278s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:40 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1d52282c-a92c-4a93-b4cc-d38aa84e0453 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Create snapshot completed successfully Sep 09 17:48:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "cinder-c68c25d8-e202-4c58-bd5a-1443b23d3d62-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-c68c25d8-e202-4c58-bd5a-1443b23d3d62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "cinder-quobyte-31d07f53-e0a5-4f09-b85d-a49c83529e5c" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-quobyte-31d07f53-e0a5-4f09-b85d-a49c83529e5c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "cinder-quobyte-c68c25d8-e202-4c58-bd5a-1443b23d3d62" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-quobyte-c68c25d8-e202-4c58-bd5a-1443b23d3d62" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Deleting offline snapshot c68c25d8-e202-4c58-bd5a-1443b23d3d62 of volume 31d07f53-e0a5-4f09-b85d-a49c83529e5c {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] snapshot_file for this snap is: volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e539d-8d9e-49df-aa0b-7aaf3a5bbcca]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:42 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 Sep 09 17:48:42 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:42 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62" returned: 0 in 0.362s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e827516-660e-4ad8-9604-84b04cfb3246]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:42 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c Sep 09 17:48:42 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:42 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c" returned: 0 in 0.400s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:42 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 Sep 09 17:48:42 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:43 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62" returned: 0 in 0.323s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:43 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62 Sep 09 17:48:43 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:43 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c.c68c25d8-e202-4c58-bd5a-1443b23d3d62" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-quobyte-c68c25d8-e202-4c58-bd5a-1443b23d3d62" released by "_delete_snapshot" :: held 1.440s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:48:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-quobyte-31d07f53-e0a5-4f09-b85d-a49c83529e5c" released by "delete_snapshot" :: held 1.468s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:48:43 devstack cinder-volume[87202]: WARNING cinder.quota [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:48:43 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Created reservations ['61d2a2f1-d310-481d-9d51-c1c687471b5f', 'ec597496-8641-496d-9ba4-9527eebb9a57', 'a99fe23c-cf09-4da7-9b7b-4f231f9641e1', 'e799a26b-0b54-463c-b3be-66161e32b1c3'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:48:43 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Delete snapshot completed successfully. Sep 09 17:48:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb00723f-5864-4885-999b-2ae26353f366 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-c68c25d8-e202-4c58-bd5a-1443b23d3d62-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Flow 'volume_create_manager' (86361dc5-15a5-43de-9368-42ff5c183c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87576c5c-1a0a-498f-b644-d6c81a38cbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87576c5c-1a0a-498f-b644-d6c81a38cbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-483820243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d90985558b4c6ea37bf63ab3f4bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:44Z,use_quota=True,user_id='9dc4cc73f13d4cecaf1d8f40734c7db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1dc68f-d102-45ea-be97-79372b4a20d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1dc68f-d102-45ea-be97-79372b4a20d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f97f638-b86d-4398-ba4c-310296c0d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f97f638-b86d-4398-ba4c-310296c0d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb', 'volume_name': 'volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905734d7-1a5a-4263-92f4-fdd208822539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905734d7-1a5a-4263-92f4-fdd208822539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c39e419-0381-4648-bcac-7021200dc0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:44 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Volume 4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb', 'volume_size': 1} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-483820243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d90985558b4c6ea37bf63ab3f4bdbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:44Z,use_quota=True,user_id='9dc4cc73f13d4cecaf1d8f40734c7db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Creating volume 4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:48:44 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "cinder-31d07f53-e0a5-4f09-b85d-a49c83529e5c-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:44 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb 1073741824 Sep 09 17:48:44 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-31d07f53-e0a5-4f09-b85d-a49c83529e5c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "cinder-quobyte-31d07f53-e0a5-4f09-b85d-a49c83529e5c" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-quobyte-31d07f53-e0a5-4f09-b85d-a49c83529e5c" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec7f8bb-09dc-4ac0-b1d0-29fa3e529b98]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:44 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c Sep 09 17:48:44 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:44 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb 1073741824" returned: 0 in 0.483s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:44 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb Sep 09 17:48:44 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:44 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c" returned: 0 in 0.513s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:45 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c Sep 09 17:48:45 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:45 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb" returned: 0 in 0.295s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c39e419-0381-4648-bcac-7021200dc0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54e05d7-63e5-429d-a21c-21781a0301d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:45 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Volume volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb (4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb): created successfully Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54e05d7-63e5-429d-a21c-21781a0301d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Flow 'volume_create_manager' (86361dc5-15a5-43de-9368-42ff5c183c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-508487f0-0dfe-4276-a753-046df1694b10 tempest-AttachVolumeShelveTestJSON-379693979 None] Created volume successfully. Sep 09 17:48:45 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-31d07f53-e0a5-4f09-b85d-a49c83529e5c" returned: 0 in 0.419s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-quobyte-31d07f53-e0a5-4f09-b85d-a49c83529e5c" released by "delete_volume" :: held 1.031s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Created reservations ['bec60a38-6626-457d-82b1-f5db06c9c37e', 'f509c162-2386-4941-92ce-5e6337a2c282', '5778c21f-cc35-4cc0-b0ab-8b74981e5255', 'b4374d5d-4770-43d1-a433-286f1056b4be'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:45 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:48:45 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:45 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.244s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:48:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Deleted volume successfully. Sep 09 17:48:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d79956d7-b4fb-4156-bd52-877bf2125cc4 tempest-VolumeSnapshotQuotasNegativeTestJSON-419458410 None] Lock "cinder-31d07f53-e0a5-4f09-b85d-a49c83529e5c-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:48:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-941584c1-0851-4dba-827a-12849315ee04 req-26fc63ce-f687-4821-9239-1a6c87f3662d tempest-TaggedAttachmentsTest-54691944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-941584c1-0851-4dba-827a-12849315ee04 req-26fc63ce-f687-4821-9239-1a6c87f3662d tempest-TaggedAttachmentsTest-54691944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-941584c1-0851-4dba-827a-12849315ee04 req-26fc63ce-f687-4821-9239-1a6c87f3662d tempest-TaggedAttachmentsTest-54691944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-941584c1-0851-4dba-827a-12849315ee04 req-26fc63ce-f687-4821-9239-1a6c87f3662d tempest-TaggedAttachmentsTest-54691944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9d63421-e9ba-473e-a561-2c0943692189', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:48:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-941584c1-0851-4dba-827a-12849315ee04 req-26fc63ce-f687-4821-9239-1a6c87f3662d tempest-TaggedAttachmentsTest-54691944 None] attachment_update completed successfully. Sep 09 17:48:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-43eb4349-e8ac-44e4-81e9-63d9e2fe71f9 req-5b0e3993-ae7d-4be6-8fbd-88f818c97d74 tempest-TaggedAttachmentsTest-54691944 None] Terminate volume connection completed successfully. Sep 09 17:48:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-43eb4349-e8ac-44e4-81e9-63d9e2fe71f9 req-5b0e3993-ae7d-4be6-8fbd-88f818c97d74 tempest-TaggedAttachmentsTest-54691944 None] Deleting attachment e9d63421-e9ba-473e-a561-2c0943692189. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Flow 'volume_create_manager' (a5afa726-291a-441f-9963-89ea87e6c0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d198c0f9-54f0-48e0-b9fd-3ea0997143a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d198c0f9-54f0-48e0-b9fd-3ea0997143a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-727119120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3224b2cb-88eb-4a17-8f0b-38a112504a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa89c91dbfb4aa68d6542820bdf348b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:56Z,use_quota=True,user_id='3842d20ec2d64f1fb37984411931c2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(467d4748-e537-47d5-9ec7-1f94fc420ae7),volume_type_id=467d4748-e537-47d5-9ec7-1f94fc420ae7)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a702f7-63b8-495a-89d2-d649a5636c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a702f7-63b8-495a-89d2-d649a5636c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d91a4d-f23f-4c27-93b9-81de2730a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d91a4d-f23f-4c27-93b9-81de2730a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3224b2cb-88eb-4a17-8f0b-38a112504a07', 'volume_name': 'volume-3224b2cb-88eb-4a17-8f0b-38a112504a07', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bfaa767-5728-40b0-9e4d-4c5399f173fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bfaa767-5728-40b0-9e4d-4c5399f173fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b879e21-f68e-4a33-b303-0c3c6d181aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Volume 3224b2cb-88eb-4a17-8f0b-38a112504a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3224b2cb-88eb-4a17-8f0b-38a112504a07', 'volume_size': 1} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-727119120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3224b2cb-88eb-4a17-8f0b-38a112504a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa89c91dbfb4aa68d6542820bdf348b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:48:56Z,use_quota=True,user_id='3842d20ec2d64f1fb37984411931c2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(467d4748-e537-47d5-9ec7-1f94fc420ae7),volume_type_id=467d4748-e537-47d5-9ec7-1f94fc420ae7)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Creating volume 3224b2cb-88eb-4a17-8f0b-38a112504a07 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:48:56 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:56 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 1073741824 Sep 09 17:48:56 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:56 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 1073741824" returned: 0 in 0.534s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:56 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 Sep 09 17:48:56 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:57 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07" returned: 0 in 0.355s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:48:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b879e21-f68e-4a33-b303-0c3c6d181aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3224b2cb-88eb-4a17-8f0b-38a112504a07', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4363a9-d70a-48a6-ae28-9de80509b657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:48:57 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Volume volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 (3224b2cb-88eb-4a17-8f0b-38a112504a07): created successfully Sep 09 17:48:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4363a9-d70a-48a6-ae28-9de80509b657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:48:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Flow 'volume_create_manager' (a5afa726-291a-441f-9963-89ea87e6c0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:48:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5739d0f9-15cd-4f86-9206-525164733603 tempest-VolumeTypesAccessTest-2047535700 None] Created volume successfully. Sep 09 17:48:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Acquiring lock "cinder-3224b2cb-88eb-4a17-8f0b-38a112504a07-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Lock "cinder-3224b2cb-88eb-4a17-8f0b-38a112504a07-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-f0528aac-5486-4930-8312-5830759b5c8a req-9ec7655b-1518-4935-ba8a-d77968c3d825 tempest-AttachVolumeShelveTestJSON-379693979 None] No connector for attachment cf1df23b-6875-4cd3-a008-f327984a5542; skipping storage backend terminate_connection call. {{(pid=87202) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 09 17:48:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-f0528aac-5486-4930-8312-5830759b5c8a req-9ec7655b-1518-4935-ba8a-d77968c3d825 tempest-AttachVolumeShelveTestJSON-379693979 None] Deleting attachment cf1df23b-6875-4cd3-a008-f327984a5542. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:48:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Acquiring lock "cinder-quobyte-3224b2cb-88eb-4a17-8f0b-38a112504a07" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:48:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Lock "cinder-quobyte-3224b2cb-88eb-4a17-8f0b-38a112504a07" acquired by "delete_volume" :: waited 0.032s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:48:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a396a-4927-4a56-9259-0b8e5c319fa4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:48:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:58 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 Sep 09 17:48:58 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:59 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07" returned: 0 in 0.383s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:59 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07 Sep 09 17:48:59 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:59 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3224b2cb-88eb-4a17-8f0b-38a112504a07" returned: 0 in 0.277s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Lock "cinder-quobyte-3224b2cb-88eb-4a17-8f0b-38a112504a07" released by "delete_volume" :: held 0.723s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:48:59 devstack cinder-volume[87202]: WARNING cinder.quota [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1171080107 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1171080107, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:48:59 devstack cinder-volume[87202]: WARNING cinder.quota [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1171080107 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1171080107, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Created reservations ['edee2b2b-761f-4f38-acad-919329126715', 'c455ad5b-aaf9-4492-b2aa-0aebbb4298d5', '06ba918a-71af-4d4e-8a44-e426cdc0e775', '99a039de-39aa-49d2-b555-a4fd408fb420'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:48:59 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:48:59 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:48:59 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.463s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:48:59 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:48:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Deleted volume successfully. Sep 09 17:49:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76b52e32-8119-4077-af8f-8cdcf7627fcc tempest-VolumeTypesAccessTest-2047535700 None] Lock "cinder-3224b2cb-88eb-4a17-8f0b-38a112504a07-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-9b23c785-585b-4688-aeea-f3d5641c7aa5 req-35d98780-a28b-4c14-b32e-0457c0988b91 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-9b23c785-585b-4688-aeea-f3d5641c7aa5 req-35d98780-a28b-4c14-b32e-0457c0988b91 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-9b23c785-585b-4688-aeea-f3d5641c7aa5 req-35d98780-a28b-4c14-b32e-0457c0988b91 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-9b23c785-585b-4688-aeea-f3d5641c7aa5 req-35d98780-a28b-4c14-b32e-0457c0988b91 tempest-ServerActionsTestOtherA-1146837832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-d17bc096-5f69-4426-8c5f-1173578870d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00c5db63-98c3-41cd-bbfa-85d21b3da832', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:49:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-9b23c785-585b-4688-aeea-f3d5641c7aa5 req-35d98780-a28b-4c14-b32e-0457c0988b91 tempest-ServerActionsTestOtherA-1146837832 None] attachment_update completed successfully. Sep 09 17:49:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:49:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:05 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:49:05 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:05 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.384s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:49:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:49:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 8 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:49:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:49:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-6da015ba-931a-4925-bb55-968c3042c383 req-94a55939-4915-4011-9d6a-a82203d83ca5 tempest-ServerActionsTestOtherA-1146837832 None] Terminate volume connection completed successfully. Sep 09 17:49:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-6da015ba-931a-4925-bb55-968c3042c383 req-94a55939-4915-4011-9d6a-a82203d83ca5 tempest-ServerActionsTestOtherA-1146837832 None] Deleting attachment 00c5db63-98c3-41cd-bbfa-85d21b3da832. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:49:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-6da015ba-931a-4925-bb55-968c3042c383 req-91a9ae31-52a2-48c2-b75f-88ee4a458c35 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-6da015ba-931a-4925-bb55-968c3042c383 req-91a9ae31-52a2-48c2-b75f-88ee4a458c35 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-6da015ba-931a-4925-bb55-968c3042c383 req-91a9ae31-52a2-48c2-b75f-88ee4a458c35 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-6da015ba-931a-4925-bb55-968c3042c383 req-91a9ae31-52a2-48c2-b75f-88ee4a458c35 tempest-ServerActionsTestOtherA-1146837832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-d17bc096-5f69-4426-8c5f-1173578870d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91656f4b-9e82-4ea6-a0a8-b8446067ad4a', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:49:07 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-6da015ba-931a-4925-bb55-968c3042c383 req-91a9ae31-52a2-48c2-b75f-88ee4a458c35 tempest-ServerActionsTestOtherA-1146837832 None] attachment_update completed successfully. Sep 09 17:49:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Acquiring lock "cinder-10ef1c3c-04a5-459e-baa9-f88c94fcddb6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:49:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Lock "cinder-10ef1c3c-04a5-459e-baa9-f88c94fcddb6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:49:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Acquiring lock "cinder-quobyte-10ef1c3c-04a5-459e-baa9-f88c94fcddb6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:49:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Lock "cinder-quobyte-10ef1c3c-04a5-459e-baa9-f88c94fcddb6" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:49:09 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaee5ceb-35cf-47f8-b21c-c3c0b2a4a182]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:09 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 Sep 09 17:49:09 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:10 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6" returned: 0 in 0.763s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:10 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6 Sep 09 17:49:10 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:10 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10ef1c3c-04a5-459e-baa9-f88c94fcddb6" returned: 0 in 0.553s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Lock "cinder-quobyte-10ef1c3c-04a5-459e-baa9-f88c94fcddb6" released by "delete_volume" :: held 1.396s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:10 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Created reservations ['63ca5222-e20a-4e3d-a30e-9bc29e65ae36', '4a77e7b7-b750-4f82-83e4-614706d76d01', 'b4c8be6b-f7ac-48b1-81e2-182a6719566b', 'b2528884-3f8c-45cf-b975-455f378eae37'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:11 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:49:11 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:11 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.527s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:49:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Deleted volume successfully. Sep 09 17:49:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-47d9b689-b974-475d-b9e3-b2dd90e2d3c6 tempest-TaggedAttachmentsTest-54691944 None] Lock "cinder-10ef1c3c-04a5-459e-baa9-f88c94fcddb6-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:21 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=64,cinder:SELECT=67,cinder:DELETE=6,cinder:INSERT=8 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:49:21 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=70,cinder:UPDATE=62,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Flow 'volume_create_manager' (d82ad34e-10bc-453d-8e9b-ee1fb67ad21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dadda4-a25f-47fb-9626-d8525c981dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dadda4-a25f-47fb-9626-d8525c981dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1536078139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab431722-2568-42ea-b671-ee15731ba30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12f3dbb7bbe45a1a7c720d6e698c89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:33Z,use_quota=True,user_id='cb742123ebce43c68fad4313dca739fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de1edff-fb36-4ccf-8a23-95cd7df38ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de1edff-fb36-4ccf-8a23-95cd7df38ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798071ce-1aa7-4b15-ac76-4962f23fe054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798071ce-1aa7-4b15-ac76-4962f23fe054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab431722-2568-42ea-b671-ee15731ba30a', 'volume_name': 'volume-ab431722-2568-42ea-b671-ee15731ba30a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1987752-6dc3-4b17-87cb-bff35fa1f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1987752-6dc3-4b17-87cb-bff35fa1f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7806d1b-cd25-49ab-81a0-065dd528a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:32 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Volume ab431722-2568-42ea-b671-ee15731ba30a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab431722-2568-42ea-b671-ee15731ba30a', 'volume_size': 1} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1536078139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab431722-2568-42ea-b671-ee15731ba30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12f3dbb7bbe45a1a7c720d6e698c89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:33Z,use_quota=True,user_id='cb742123ebce43c68fad4313dca739fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Creating volume ab431722-2568-42ea-b671-ee15731ba30a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:49:32 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:49:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:32 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a 1073741824 Sep 09 17:49:32 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:33 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a 1073741824" returned: 0 in 0.503s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:33 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a Sep 09 17:49:33 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:33 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a" returned: 0 in 0.327s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7806d1b-cd25-49ab-81a0-065dd528a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab431722-2568-42ea-b671-ee15731ba30a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2cf57b-6f2c-4c88-9501-19fffb273e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Volume volume-ab431722-2568-42ea-b671-ee15731ba30a (ab431722-2568-42ea-b671-ee15731ba30a): created successfully Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2cf57b-6f2c-4c88-9501-19fffb273e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Flow 'volume_create_manager' (d82ad34e-10bc-453d-8e9b-ee1fb67ad21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-56617b96-e516-4f64-be07-30ae68f63ca9 tempest-VolumesTransfersV355Test-181002866 None] Created volume successfully. Sep 09 17:49:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ec6c717b-8b2a-44b9-82d9-f92e1ed6cc71 tempest-VolumesTransfersV355Test-1828219764 None] Transfer volume completed successfully. Sep 09 17:49:36 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Acquiring lock "cinder-ab431722-2568-42ea-b671-ee15731ba30a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:49:36 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Lock "cinder-ab431722-2568-42ea-b671-ee15731ba30a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:49:36 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Acquiring lock "cinder-quobyte-ab431722-2568-42ea-b671-ee15731ba30a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:49:36 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Lock "cinder-quobyte-ab431722-2568-42ea-b671-ee15731ba30a" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:49:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[987f41e4-3041-4913-9c16-5cb110f5c1a3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:36 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a Sep 09 17:49:36 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:37 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a" returned: 0 in 0.631s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:37 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a Sep 09 17:49:37 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:37 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ab431722-2568-42ea-b671-ee15731ba30a" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Lock "cinder-quobyte-ab431722-2568-42ea-b671-ee15731ba30a" released by "delete_volume" :: held 1.034s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Created reservations ['5590a2a4-534e-4836-b8c3-3d347345a985', '2c09d1e6-a47b-470e-98b1-a8bc1ee73509', 'c3504a12-8d94-4257-885c-434fc63785dc', 'cce320b3-11d0-45c7-a904-299279f1610a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:37 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:49:37 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:38 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.341s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:38 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:49:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Deleted volume successfully. Sep 09 17:49:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d998cab1-30d3-4865-bf2d-70a0a8173609 tempest-VolumesTransfersV355Test-815006779 None] Lock "cinder-ab431722-2568-42ea-b671-ee15731ba30a-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-4ef793fe-5e0d-4935-9df1-9d9351e980c4 req-47d962e6-645b-4d16-802e-38fa047ee565 tempest-ServerActionsTestOtherA-1146837832 None] Terminate volume connection completed successfully. Sep 09 17:49:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-4ef793fe-5e0d-4935-9df1-9d9351e980c4 req-47d962e6-645b-4d16-802e-38fa047ee565 tempest-ServerActionsTestOtherA-1146837832 None] Deleting attachment 91656f4b-9e82-4ea6-a0a8-b8446067ad4a. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Flow 'volume_create_manager' (1b6dde69-b883-4173-ad55-01e34ffc10d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eecc412-eed0-46fd-8c5c-bf1c493ab669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eecc412-eed0-46fd-8c5c-bf1c493ab669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-858070333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d81a6d-8d88-408e-9844-66dfee14c5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12f3dbb7bbe45a1a7c720d6e698c89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:40Z,use_quota=True,user_id='cb742123ebce43c68fad4313dca739fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af216bb8-c306-41ea-8bd8-3bc7bb19c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af216bb8-c306-41ea-8bd8-3bc7bb19c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4c6e4b-25d6-4c26-bb28-10f91bf0695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4c6e4b-25d6-4c26-bb28-10f91bf0695b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d81a6d-8d88-408e-9844-66dfee14c5c0', 'volume_name': 'volume-43d81a6d-8d88-408e-9844-66dfee14c5c0', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db62295-df80-4369-a7f2-41eb6f84730e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db62295-df80-4369-a7f2-41eb6f84730e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096ac5fd-b76e-40a3-9ba5-e1c18cb2f3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:40 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Volume 43d81a6d-8d88-408e-9844-66dfee14c5c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d81a6d-8d88-408e-9844-66dfee14c5c0', 'volume_size': 1} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-858070333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d81a6d-8d88-408e-9844-66dfee14c5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12f3dbb7bbe45a1a7c720d6e698c89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:40Z,use_quota=True,user_id='cb742123ebce43c68fad4313dca739fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Creating volume 43d81a6d-8d88-408e-9844-66dfee14c5c0 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:49:40 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:49:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:40 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 1073741824 Sep 09 17:49:40 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:41 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 1073741824" returned: 0 in 0.844s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:41 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 Sep 09 17:49:41 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:41 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0" returned: 0 in 0.442s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096ac5fd-b76e-40a3-9ba5-e1c18cb2f3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d81a6d-8d88-408e-9844-66dfee14c5c0', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fed11b-65bc-439f-8a00-e5cf67f43e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:41 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Volume volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 (43d81a6d-8d88-408e-9844-66dfee14c5c0): created successfully Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fed11b-65bc-439f-8a00-e5cf67f43e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Flow 'volume_create_manager' (1b6dde69-b883-4173-ad55-01e34ffc10d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8c9c5c1b-77db-42fa-baca-77e46e27f4c8 tempest-VolumesTransfersV355Test-181002866 None] Created volume successfully. Sep 09 17:49:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Acquiring lock "cinder-43d81a6d-8d88-408e-9844-66dfee14c5c0-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:49:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Lock "cinder-43d81a6d-8d88-408e-9844-66dfee14c5c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:49:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Acquiring lock "cinder-quobyte-43d81a6d-8d88-408e-9844-66dfee14c5c0" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:49:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Lock "cinder-quobyte-43d81a6d-8d88-408e-9844-66dfee14c5c0" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:49:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[895da565-fd6a-472f-bbc2-51ca0638b4e7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:42 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 Sep 09 17:49:42 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:43 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0" returned: 0 in 0.530s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:43 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0 Sep 09 17:49:43 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:43 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-43d81a6d-8d88-408e-9844-66dfee14c5c0" returned: 0 in 0.304s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Lock "cinder-quobyte-43d81a6d-8d88-408e-9844-66dfee14c5c0" released by "delete_volume" :: held 0.889s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Created reservations ['22a546f8-a7b0-4438-b5ac-b20771abf8bb', 'af176f83-075e-4d93-8080-416dbd96c22c', '9ea94764-6cf9-4267-8c37-1353799d3c95', 'd6d538f4-2c1d-40c2-8804-07f73968de3a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:43 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:49:43 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:44 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.354s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:44 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:49:44 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Deleted volume successfully. Sep 09 17:49:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-53fb81d1-1826-426d-91a6-9fccd6483f11 tempest-VolumesTransfersV355Test-815006779 None] Lock "cinder-43d81a6d-8d88-408e-9844-66dfee14c5c0-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Acquiring lock "cinder-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:49:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "cinder-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:49:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Acquiring lock "cinder-quobyte-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:49:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "cinder-quobyte-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:49:46 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d2325b-7b19-44da-893d-d59593016248]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:46 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb Sep 09 17:49:46 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:47 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb" returned: 0 in 0.519s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:47 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb Sep 09 17:49:47 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Flow 'volume_create_manager' (021d706a-ac5a-4cdb-ba78-4d407d9bc6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fa4fbc-e5ec-4833-a15d-96d4e79a900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fa4fbc-e5ec-4833-a15d-96d4e79a900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1942501510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d930e7b-8b12-4a26-90a2-ae336a750507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7dabc10b44d8c982a6c0a13d6ebf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:47Z,use_quota=True,user_id='9d08fde7d2534efaaa588ada180fbdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b5ee62-514a-4437-a5a8-6dee9d2ca67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b5ee62-514a-4437-a5a8-6dee9d2ca67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9169b911-f856-4ab0-b09e-edfcd67a8955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 17:49:47 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb" returned: 0 in 0.287s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "cinder-quobyte-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb" released by "delete_volume" :: held 0.864s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Created reservations ['232ef87f-69d9-40e6-84f5-4c8e0deaa6cf', 'e260e2e3-0d46-43fc-8955-447fcf3ed173', '5ed19f98-eaf5-429a-95a7-80978da66e2d', '2db2c31c-d89f-45de-9dd9-fa4769811d28'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:47 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:49:47 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:47 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.319s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:49:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Deleted volume successfully. Sep 09 17:49:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e7bd83-2d08-4b8d-934a-8d93d42515d3 tempest-AttachVolumeShelveTestJSON-379693979 None] Lock "cinder-4b4b78c2-5c5a-4a93-8068-b38dcbcf7ceb-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:49:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9169b911-f856-4ab0-b09e-edfcd67a8955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d930e7b-8b12-4a26-90a2-ae336a750507', 'volume_name': 'volume-8d930e7b-8b12-4a26-90a2-ae336a750507', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5534d813-8f71-4ef4-8b81-fd1d4ff7bde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5534d813-8f71-4ef4-8b81-fd1d4ff7bde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df13403-1a8d-44e6-9e11-96a41742961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:48 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Volume 8d930e7b-8b12-4a26-90a2-ae336a750507: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d930e7b-8b12-4a26-90a2-ae336a750507', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 17:49:48 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Trying to clone 8d930e7b-8b12-4a26-90a2-ae336a750507 from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 17:49:48 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 17:49:48 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Image download 20.69 MB at 20.69 MB/s Sep 09 17:49:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9c6eb9-6f4e-46a9-8743-e51f2e85b342]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:48 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD Sep 09 17:49:48 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:49 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe is fetched for user 9d08fde7d2534efaaa588ada180fbdb1. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe37fd43-24ed-4883-8d94-b7283c0be1a3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:49 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD Sep 09 17:49:49 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:49 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1942501510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d930e7b-8b12-4a26-90a2-ae336a750507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ea7dabc10b44d8c982a6c0a13d6ebf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:47Z,use_quota=True,user_id='9d08fde7d2534efaaa588ada180fbdb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Creating volume 8d930e7b-8b12-4a26-90a2-ae336a750507 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:49:49 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:49:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:49 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 1073741824 Sep 09 17:49:49 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:50 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 1073741824" returned: 0 in 0.546s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:50 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 Sep 09 17:49:50 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:50 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507" returned: 0 in 0.355s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:49:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:50 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Attempting download of d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 8d930e7b-8b12-4a26-90a2-ae336a750507. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 17:49:50 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f5ac97-59e4-4efe-ae75-602267b71123]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_a16fl83v {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:50 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_a16fl83v Sep 09 17:49:50 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:51 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_a16fl83v" returned: 0 in 0.350s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_a16fl83v {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:51 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_a16fl83v Sep 09 17:49:51 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:51 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_a16fl83v" returned: 1 in 0.463s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_a16fl83v' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:49:51 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85740a6-c5a9-4ea6-81d8-55df363c57cf]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:51 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD Sep 09 17:49:51 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:51 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe was qcow2, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:52 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 Sep 09 17:49:52 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Flow 'volume_create_manager' (409fa8e0-9d21-4090-939f-d7da455781cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5c471c-f273-4be0-aa81-6dd6fc38b501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5c471c-f273-4be0-aa81-6dd6fc38b501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-511966929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7da331f-e1fe-4141-b236-4cbd6fc7e7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224e72b3d34d4a2ebf58cb197c07add8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:52Z,use_quota=True,user_id='7331fcc74c4e49f3b3a916504d9bdd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5086eb2d-bd6e-4636-acba-046a1e95a4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5086eb2d-bd6e-4636-acba-046a1e95a4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54428d0a-639f-4836-9931-5faf946e36e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54428d0a-639f-4836-9931-5faf946e36e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7da331f-e1fe-4141-b236-4cbd6fc7e7ef', 'volume_name': 'volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7283e1-0c81-4f5b-8cdc-d4d9a7d214c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7283e1-0c81-4f5b-8cdc-d4d9a7d214c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b731983-74b3-4fa7-9425-eeda0f368251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:52 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Volume d7da331f-e1fe-4141-b236-4cbd6fc7e7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef', 'volume_size': 1} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-511966929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7da331f-e1fe-4141-b236-4cbd6fc7e7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224e72b3d34d4a2ebf58cb197c07add8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:52Z,use_quota=True,user_id='7331fcc74c4e49f3b3a916504d9bdd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Creating volume d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:49:52 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:49:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:52 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef 1073741824 Sep 09 17:49:52 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:53 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef 1073741824" returned: 0 in 0.926s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:53 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef Sep 09 17:49:53 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:54 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" returned: 0 in 0.758s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:49:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:49:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b731983-74b3-4fa7-9425-eeda0f368251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77baa4d-3993-4154-ac46-3f54096b4d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:54 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Volume volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef (d7da331f-e1fe-4141-b236-4cbd6fc7e7ef): created successfully Sep 09 17:49:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77baa4d-3993-4154-ac46-3f54096b4d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Flow 'volume_create_manager' (409fa8e0-9d21-4090-939f-d7da455781cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-013c96d0-9d90-4252-ba7c-79ac54fc9e3e tempest-VolumesCloneTest-1429823050 None] Created volume successfully. Sep 09 17:49:55 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507" returned: 0 in 3.434s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_0k0hgqq0devstack@QuobyteHD, size 112.00 MB, duration 3.43 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:49:55 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Converted 112.00 MB image at 32.61 MB/s Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:55 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 1G Sep 09 17:49:55 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:55 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 1G" returned: 0 in 0.468s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Downloaded image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 8d930e7b-8b12-4a26-90a2-ae336a750507 successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe for user 9d08fde7d2534efaaa588ada180fbdb1 is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Marking volume 8d930e7b-8b12-4a26-90a2-ae336a750507 as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Copying metadata from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe to 8d930e7b-8b12-4a26-90a2-ae336a750507. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 17:49:55 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Creating volume glance metadata for volume 8d930e7b-8b12-4a26-90a2-ae336a750507 backed by image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df13403-1a8d-44e6-9e11-96a41742961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d930e7b-8b12-4a26-90a2-ae336a750507', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5f8d93-1844-45d7-b5e6-c3397ddbbb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Volume volume-8d930e7b-8b12-4a26-90a2-ae336a750507 (8d930e7b-8b12-4a26-90a2-ae336a750507): created successfully Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5f8d93-1844-45d7-b5e6-c3397ddbbb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Flow 'volume_create_manager' (021d706a-ac5a-4cdb-ba78-4d407d9bc6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-34438ff6-4a31-4199-8fd9-1f350e470064 tempest-ServerActionsTestOtherA-1146837832 None] Created volume successfully. Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Flow 'volume_create_manager' (a983df68-ac95-453d-8351-3726acecd693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fd3458-60db-4b63-aeb1-16f4d4d9ce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fd3458-60db-4b63-aeb1-16f4d4d9ce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-879024669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3097aa-59d5-4e20-b4ef-6c981f4acc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='224e72b3d34d4a2ebf58cb197c07add8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:49:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d7da331f-e1fe-4141-b236-4cbd6fc7e7ef,status='creating',terminated_at=None,updated_at=2026-09-09T15:49:56Z,use_quota=True,user_id='7331fcc74c4e49f3b3a916504d9bdd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7c5286-b4c4-4208-abe0-90ff9f6cbf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7c5286-b4c4-4208-abe0-90ff9f6cbf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6d6d9a-6076-41e8-8af5-29dfe16f04ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6d6d9a-6076-41e8-8af5-29dfe16f04ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'aa3097aa-59d5-4e20-b4ef-6c981f4acc6e', 'volume_name': 'volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e', 'volume_size': 2, 'source_volid': 'd7da331f-e1fe-4141-b236-4cbd6fc7e7ef', 'source_volstatus': 'available'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51557772-09e3-41a2-976d-f43b3e5793cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51557772-09e3-41a2-976d-f43b3e5793cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33337228-18e8-4b06-9976-30595719eaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:49:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Volume aa3097aa-59d5-4e20-b4ef-6c981f4acc6e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e', 'volume_size': 2, 'source_volid': 'd7da331f-e1fe-4141-b236-4cbd6fc7e7ef', 'source_volstatus': 'available'} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:49:56 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Cloning volume d7da331f-e1fe-4141-b236-4cbd6fc7e7ef to volume aa3097aa-59d5-4e20-b4ef-6c981f4acc6e Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Creating offline snapshot 046d1ecb-a12b-421c-bfe0-2e179e4287f3 of volume d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fc457a-6b60-43ee-9d0c-3523c7fe7b4d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:49:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:56 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef Sep 09 17:49:56 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:57 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" returned: 0 in 0.509s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:57 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 1G Sep 09 17:49:57 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:58 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 1G" returned: 0 in 0.813s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:58 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 Sep 09 17:49:58 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:58 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3" returned: 0 in 0.409s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:58 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 is being set with open permissions: ugo+rw Sep 09 17:49:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:58 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 Sep 09 17:49:58 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:59 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3" returned: 0 in 0.549s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:59 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.info Sep 09 17:49:59 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:59 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Sep 09 17:49:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.info" returned: 0 in 0.409s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:49:59 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.info is being set with open permissions: ugo+rw Sep 09 17:49:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:49:59 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.info Sep 09 17:49:59 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:49:59 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Flow 'volume_create_manager' (a267ae0f-e9b5-4c71-8359-41259010e29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7593b21-048a-4b6e-b2b4-ba54e9d283de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.info" returned: 0 in 0.564s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Acquiring lock "cinder-quobyte-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7593b21-048a-4b6e-b2b4-ba54e9d283de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1585533337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b994c27-d738-4e79-bb75-a1570fc085fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f1d4eb5ce40eca3a4958a3c8096ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:00Z,use_quota=True,user_id='56a2b03a651a42b08fd15f84174ecb10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824565f8-184f-4c91-94da-7b3819097fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824565f8-184f-4c91-94da-7b3819097fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174da446-b48c-450e-8b10-7d55acf8a95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174da446-b48c-450e-8b10-7d55acf8a95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b994c27-d738-4e79-bb75-a1570fc085fa', 'volume_name': 'volume-7b994c27-d738-4e79-bb75-a1570fc085fa', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b593d6f3-3fdc-43f4-bebe-9a45431840dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b593d6f3-3fdc-43f4-bebe-9a45431840dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60537e93-6a61-4fb0-907c-7f3f0fc3772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Volume 7b994c27-d738-4e79-bb75-a1570fc085fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b994c27-d738-4e79-bb75-a1570fc085fa', 'volume_size': 1} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Lock "cinder-quobyte-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" acquired by "_copy_volume_from_snapshot" :: waited 0.102s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] snapshot: 046d1ecb-a12b-421c-bfe0-2e179e4287f3, volume: aa3097aa-59d5-4e20-b4ef-6c981f4acc6e, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[036c1676-237e-45dd-9f36-8001739c46b7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:00 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 Sep 09 17:50:00 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:00 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3" returned: 0 in 0.426s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[153f5a4d-373a-4e63-90b2-fda926beacec]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:00 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef Sep 09 17:50:00 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-d1ab0dfb-04eb-4fd7-b985-da637a81822e req-f1d01d42-2aba-433e-a946-a1188ff59422 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:01 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" returned: 0 in 0.580s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:50:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:50:01 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:50:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:01 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e Sep 09 17:50:01 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:50:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:05 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:50:05 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.935s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:50:05 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:50:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:50:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:50:07 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" returned: 0 in 6.563s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:07 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:50:07 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Converted 1024.00 MB image at 155.99 MB/s Sep 09 17:50:07 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e is being set with open permissions: ugo+rw Sep 09 17:50:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:07 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e Sep 09 17:50:07 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:08 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Lock "cinder-quobyte-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" released by "_copy_volume_from_snapshot" :: held 7.893s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Acquiring lock "cinder-quobyte-046d1ecb-a12b-421c-bfe0-2e179e4287f3" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Lock "cinder-quobyte-046d1ecb-a12b-421c-bfe0-2e179e4287f3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Deleting offline snapshot 046d1ecb-a12b-421c-bfe0-2e179e4287f3 of volume d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] snapshot_file for this snap is: volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc0f4eb-278e-4857-a888-667d813e0615]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:08 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 Sep 09 17:50:08 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:08 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3" returned: 0 in 0.349s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff6e516-9398-46e2-bf10-8c3ae62c1001]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:08 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef Sep 09 17:50:08 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:08 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" returned: 0 in 0.481s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:09 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 Sep 09 17:50:09 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:09 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3" returned: 0 in 0.342s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:09 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3 Sep 09 17:50:09 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:09 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef.046d1ecb-a12b-421c-bfe0-2e179e4287f3" returned: 0 in 0.235s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Lock "cinder-quobyte-046d1ecb-a12b-421c-bfe0-2e179e4287f3" released by "_delete_snapshot" :: held 1.493s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.981s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.469s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1585533337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b994c27-d738-4e79-bb75-a1570fc085fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f1d4eb5ce40eca3a4958a3c8096ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:00Z,use_quota=True,user_id='56a2b03a651a42b08fd15f84174ecb10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Creating volume 7b994c27-d738-4e79-bb75-a1570fc085fa {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:50:09 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:09 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa 1073741824 Sep 09 17:50:09 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33337228-18e8-4b06-9976-30595719eaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e', 'volume_size': 2, 'source_volid': 'd7da331f-e1fe-4141-b236-4cbd6fc7e7ef', 'source_volstatus': 'available'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b99bf93-a95b-449b-b8d8-7472ace542bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:09 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Volume volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e (aa3097aa-59d5-4e20-b4ef-6c981f4acc6e): created successfully Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b99bf93-a95b-449b-b8d8-7472ace542bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Flow 'volume_create_manager' (a983df68-ac95-453d-8351-3726acecd693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:09 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2a764a5f-a9fe-44d6-8632-dfd389f7036e tempest-VolumesCloneTest-1429823050 None] Created volume successfully. Sep 09 17:50:10 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa 1073741824" returned: 0 in 0.411s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:10 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa Sep 09 17:50:10 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Acquiring lock "cinder-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Lock "cinder-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:10 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa" returned: 0 in 0.256s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-d1ab0dfb-04eb-4fd7-b985-da637a81822e req-f1d01d42-2aba-433e-a946-a1188ff59422 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.179s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60537e93-6a61-4fb0-907c-7f3f0fc3772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b994c27-d738-4e79-bb75-a1570fc085fa', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457cd46e-79e5-4583-8bb5-81af129ba174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Acquiring lock "cinder-quobyte-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:10 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Volume volume-7b994c27-d738-4e79-bb75-a1570fc085fa (7b994c27-d738-4e79-bb75-a1570fc085fa): created successfully Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457cd46e-79e5-4583-8bb5-81af129ba174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Flow 'volume_create_manager' (a267ae0f-e9b5-4c71-8359-41259010e29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Lock "cinder-quobyte-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-d1ab0dfb-04eb-4fd7-b985-da637a81822e req-f1d01d42-2aba-433e-a946-a1188ff59422 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.147s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:10 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-7cf0b583-b57c-494c-b64f-cd6b4278a8fd req-a3c6398a-033d-4c2f-a369-9f6b0de39a1f tempest-VolumesSnapshotsTestJSON-917787763 None] Created volume successfully. Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff0954d-4cc3-4eb2-8f50-8a5436d8f475]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-d1ab0dfb-04eb-4fd7-b985-da637a81822e req-f1d01d42-2aba-433e-a946-a1188ff59422 tempest-ServerActionsTestOtherA-1146837832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-8d930e7b-8b12-4a26-90a2-ae336a750507', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aff9ac95-c378-4f17-8804-abc40f86a8c6', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:50:10 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-d1ab0dfb-04eb-4fd7-b985-da637a81822e req-f1d01d42-2aba-433e-a946-a1188ff59422 tempest-ServerActionsTestOtherA-1146837832 None] attachment_update completed successfully. Sep 09 17:50:10 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e Sep 09 17:50:10 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:10 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" returned: 0 in 0.403s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:10 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e Sep 09 17:50:10 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Creating offline snapshot 1ea96142-933d-4940-905e-ce9e4e811a0d of volume 7b994c27-d738-4e79-bb75-a1570fc085fa {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eee195-be44-4bc1-8105-47baac67228d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:11 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa Sep 09 17:50:11 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:11 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" returned: 0 in 0.282s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Lock "cinder-quobyte-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e" released by "delete_volume" :: held 0.738s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Created reservations ['ec5d7d1b-ab67-45f1-9fd8-cfd89d155247', 'f1bb0524-a656-4444-8e3f-356a90d2928e', '541596c1-54f8-49f0-ade1-74f72b5b1174', '1c2aea6f-e773-4cde-a9ab-e368a3552134'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:11 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:50:11 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:11 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Acquiring lock "cinder-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa" returned: 0 in 0.653s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:11 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d 1G Sep 09 17:50:11 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Lock "cinder-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Acquiring lock "cinder-quobyte-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Lock "cinder-quobyte-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac5ecb-d148-4d76-b987-ddb6729d5aba]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:12 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.537s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:50:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Deleted volume successfully. Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca078770-727a-4cdf-9e41-c5eeccf82c12 tempest-VolumesCloneTest-1429823050 None] Lock "cinder-aa3097aa-59d5-4e20-b4ef-6c981f4acc6e-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:12 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef Sep 09 17:50:12 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:12 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d 1G" returned: 0 in 0.651s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b994c27-d738-4e79-bb75-a1570fc085fa -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:12 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b994c27-d738-4e79-bb75-a1570fc085fa -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d Sep 09 17:50:12 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:12 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" returned: 0 in 0.551s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:12 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef Sep 09 17:50:12 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:12 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b994c27-d738-4e79-bb75-a1570fc085fa -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d" returned: 0 in 0.362s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:12 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d is being set with open permissions: ugo+rw Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:12 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d Sep 09 17:50:12 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:12 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Lock "cinder-quobyte-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef" released by "delete_volume" :: held 0.914s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Created reservations ['88d788d0-9cdf-4e48-9bbe-2b283d4c1089', 'd0d9f8e7-d103-4118-9574-7cd143f94a70', '480e09e9-110a-482a-a93e-a156d9d4727f', '10459746-22d5-47d5-9cb4-b952f09c770b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:12 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:50:12 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:12 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d" returned: 0 in 0.269s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:13 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.info Sep 09 17:50:13 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:13 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.312s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:13 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:50:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Deleted volume successfully. Sep 09 17:50:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5bfcdc20-2b1f-4fe8-91ca-001aed83a2e1 tempest-VolumesCloneTest-1429823050 None] Lock "cinder-d7da331f-e1fe-4141-b236-4cbd6fc7e7ef-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:13 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.info" returned: 0 in 0.444s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:13 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.info is being set with open permissions: ugo+rw Sep 09 17:50:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:13 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.info Sep 09 17:50:13 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:13 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.info" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-561b4d8c-2a62-4693-bec7-345486c64e85 req-a15891cc-05c9-41b7-a3ff-ac1395eb6b3b tempest-VolumesSnapshotsTestJSON-917787763 None] Create snapshot completed successfully Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "cinder-1ea96142-933d-4940-905e-ce9e4e811a0d-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-1ea96142-933d-4940-905e-ce9e4e811a0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "cinder-quobyte-7b994c27-d738-4e79-bb75-a1570fc085fa" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-quobyte-7b994c27-d738-4e79-bb75-a1570fc085fa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "cinder-quobyte-1ea96142-933d-4940-905e-ce9e4e811a0d" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-quobyte-1ea96142-933d-4940-905e-ce9e4e811a0d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Deleting offline snapshot 1ea96142-933d-4940-905e-ce9e4e811a0d of volume 7b994c27-d738-4e79-bb75-a1570fc085fa {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] snapshot_file for this snap is: volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e2b48d-b6d0-4664-ab97-79aa17034fee]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:14 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d Sep 09 17:50:14 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:15 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d" returned: 0 in 0.606s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b994c27-d738-4e79-bb75-a1570fc085fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:50:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a768bea3-8059-4666-a425-204b0740d300]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:15 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa Sep 09 17:50:15 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:16 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa" returned: 0 in 0.640s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:16 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d Sep 09 17:50:16 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:16 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d" returned: 0 in 0.597s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:16 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d Sep 09 17:50:16 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:17 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa.1ea96142-933d-4940-905e-ce9e4e811a0d" returned: 0 in 0.452s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-quobyte-1ea96142-933d-4940-905e-ce9e4e811a0d" released by "_delete_snapshot" :: held 2.515s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-quobyte-7b994c27-d738-4e79-bb75-a1570fc085fa" released by "delete_snapshot" :: held 2.557s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:17 devstack cinder-volume[87202]: DEBUG cinder.quota [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Created reservations ['72899250-e215-4d4f-aeac-5ffe6500b310', 'c82970bb-5b14-4c1d-a3fb-33debfc75d96', 'f235ca88-9f1f-4749-b0b6-f177f28091f7', 'baac0b06-4421-4e4b-ac3f-9a3958f21230'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:50:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Delete snapshot completed successfully. Sep 09 17:50:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-6848ae4c-3d6f-4bba-93c8-34835e71ed8e req-ee9ea7e7-660f-42ca-be89-26f85c8a2cdf tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-1ea96142-933d-4940-905e-ce9e4e811a0d-delete_snapshot" released by "delete_snapshot" :: held 2.785s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "cinder-7b994c27-d738-4e79-bb75-a1570fc085fa-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-7b994c27-d738-4e79-bb75-a1570fc085fa-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "cinder-quobyte-7b994c27-d738-4e79-bb75-a1570fc085fa" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-quobyte-7b994c27-d738-4e79-bb75-a1570fc085fa" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:18 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ea7656-5533-488b-8f84-fefe47f6b0d5]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:18 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa Sep 09 17:50:18 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:18 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa" returned: 0 in 0.521s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:18 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa Sep 09 17:50:18 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:19 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b994c27-d738-4e79-bb75-a1570fc085fa" returned: 0 in 0.576s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-quobyte-7b994c27-d738-4e79-bb75-a1570fc085fa" released by "delete_volume" :: held 1.213s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG cinder.quota [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Created reservations ['aef98e8e-bb17-4909-aa49-57555ff0f89a', 'c766e243-5bb5-4938-8985-a3ebd6b80500', '1dd46283-a46c-4a6a-a688-d3fef0defd1a', '5990bbde-1781-4553-93e3-9afe8d9d016a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:19 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:50:19 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Flow 'volume_create_manager' (054d1664-af84-4d7c-a3b3-ec9e070c2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:20 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28403d86-eed2-4351-bff5-762babdb0cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.604s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.manager [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:50:20 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Deleted volume successfully. Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28403d86-eed2-4351-bff5-762babdb0cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-478511471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052a8693-72f4-435c-bf13-64b899afc5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f85e14870e44be3b959e53308cf6e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:20Z,use_quota=True,user_id='f3a8f4091a9a4e6ea1ac0a887cb88e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028db92c-a992-4cb5-be26-725b23aee2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028db92c-a992-4cb5-be26-725b23aee2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4d0a03-6b41-43db-849c-e9f7ea23490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4d0a03-6b41-43db-849c-e9f7ea23490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052a8693-72f4-435c-bf13-64b899afc5f4', 'volume_name': 'volume-052a8693-72f4-435c-bf13-64b899afc5f4', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43c1250-a597-4edc-9247-1402a2c6ec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43c1250-a597-4edc-9247-1402a2c6ec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3ae157-0694-4137-9124-995d2c4b8105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:20 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Volume 052a8693-72f4-435c-bf13-64b899afc5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052a8693-72f4-435c-bf13-64b899afc5f4', 'volume_size': 1} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-478511471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052a8693-72f4-435c-bf13-64b899afc5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f85e14870e44be3b959e53308cf6e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:20Z,use_quota=True,user_id='f3a8f4091a9a4e6ea1ac0a887cb88e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Creating volume 052a8693-72f4-435c-bf13-64b899afc5f4 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:50:20 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:20 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 1073741824 Sep 09 17:50:20 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-35486b9f-adcb-41bc-bb67-23a9e98cd365 req-2ee19c36-1d00-4ccf-ae20-32e8b9850cc2 tempest-VolumesSnapshotsTestJSON-917787763 None] Lock "cinder-7b994c27-d738-4e79-bb75-a1570fc085fa-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:20 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Flow 'volume_create_manager' (e6d67a96-ab80-4795-9d46-1b150cee7385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c8e5f1-07b4-465b-ae1f-5cc4ea1601f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c8e5f1-07b4-465b-ae1f-5cc4ea1601f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-962546768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a04e2ed-53f2-493e-ac7b-0aba2b55c96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c614eec19e4c9592344fa926c322d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:21Z,use_quota=True,user_id='36c065953e094a1ba6805487cf7e8b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd2d62d-e2ac-4943-990f-0e812aca6b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd2d62d-e2ac-4943-990f-0e812aca6b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9acec46-092b-40e2-8c9b-9fbfd870a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9acec46-092b-40e2-8c9b-9fbfd870a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a04e2ed-53f2-493e-ac7b-0aba2b55c96e', 'volume_name': 'volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c54698-d568-4674-bde5-e2490a681400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c54698-d568-4674-bde5-e2490a681400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473d3442-2813-4165-9e77-318a9913b8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:21 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Volume 0a04e2ed-53f2-493e-ac7b-0aba2b55c96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e', 'volume_size': 1} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:21 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 1073741824" returned: 0 in 0.756s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:21 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 Sep 09 17:50:21 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:21 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4" returned: 0 in 0.416s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-962546768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a04e2ed-53f2-493e-ac7b-0aba2b55c96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c614eec19e4c9592344fa926c322d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:21Z,use_quota=True,user_id='36c065953e094a1ba6805487cf7e8b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Creating volume 0a04e2ed-53f2-493e-ac7b-0aba2b55c96e {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:50:21 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3ae157-0694-4137-9124-995d2c4b8105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052a8693-72f4-435c-bf13-64b899afc5f4', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be60e6fe-5791-4b86-a8c1-94a1f49d20d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:22 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Volume volume-052a8693-72f4-435c-bf13-64b899afc5f4 (052a8693-72f4-435c-bf13-64b899afc5f4): created successfully Sep 09 17:50:22 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e 1073741824 Sep 09 17:50:22 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be60e6fe-5791-4b86-a8c1-94a1f49d20d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Flow 'volume_create_manager' (054d1664-af84-4d7c-a3b3-ec9e070c2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-307d0548-2094-4848-891a-bf01e2a931a8 tempest-AttachVolumeNegativeTest-1931294304 None] Created volume successfully. Sep 09 17:50:22 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e 1073741824" returned: 0 in 0.769s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:22 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e Sep 09 17:50:22 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:23 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e" returned: 0 in 0.427s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:50:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473d3442-2813-4165-9e77-318a9913b8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b358b7-0b3c-42ab-9446-e8198bbbce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:23 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Volume volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e (0a04e2ed-53f2-493e-ac7b-0aba2b55c96e): created successfully Sep 09 17:50:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b358b7-0b3c-42ab-9446-e8198bbbce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Flow 'volume_create_manager' (e6d67a96-ab80-4795-9d46-1b150cee7385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:23 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b83e8a3e-0560-4b62-a29b-eec9ecb98cfd tempest-VolumesNegativeTest-1144887638 None] Created volume successfully. Sep 09 17:50:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-795e348f-e5a7-48ac-a01a-80a11a19b94d req-8d38154d-6c69-4d27-88a8-4261d219dea2 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-795e348f-e5a7-48ac-a01a-80a11a19b94d req-8d38154d-6c69-4d27-88a8-4261d219dea2 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-795e348f-e5a7-48ac-a01a-80a11a19b94d req-8d38154d-6c69-4d27-88a8-4261d219dea2 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-795e348f-e5a7-48ac-a01a-80a11a19b94d req-8d38154d-6c69-4d27-88a8-4261d219dea2 tempest-AttachVolumeNegativeTest-1931294304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-052a8693-72f4-435c-bf13-64b899afc5f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ba5a26c-7dc5-4848-9b89-84bd7ddb4f2a', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:50:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-795e348f-e5a7-48ac-a01a-80a11a19b94d req-8d38154d-6c69-4d27-88a8-4261d219dea2 tempest-AttachVolumeNegativeTest-1931294304 None] attachment_update completed successfully. Sep 09 17:50:26 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-fe5e78d6-0dde-4383-8253-edfb6d7d36c8 req-cea0cfaa-0474-44c8-82f9-5ba914914c34 tempest-ServerActionsTestOtherA-1146837832 None] Terminate volume connection completed successfully. Sep 09 17:50:26 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-fe5e78d6-0dde-4383-8253-edfb6d7d36c8 req-cea0cfaa-0474-44c8-82f9-5ba914914c34 tempest-ServerActionsTestOtherA-1146837832 None] Deleting attachment aff9ac95-c378-4f17-8804-abc40f86a8c6. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:50:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-fe5e78d6-0dde-4383-8253-edfb6d7d36c8 req-34d526f3-e0bd-4011-8f6b-ad96736f28f8 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-fe5e78d6-0dde-4383-8253-edfb6d7d36c8 req-34d526f3-e0bd-4011-8f6b-ad96736f28f8 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-fe5e78d6-0dde-4383-8253-edfb6d7d36c8 req-34d526f3-e0bd-4011-8f6b-ad96736f28f8 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-fe5e78d6-0dde-4383-8253-edfb6d7d36c8 req-34d526f3-e0bd-4011-8f6b-ad96736f28f8 tempest-ServerActionsTestOtherA-1146837832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-8d930e7b-8b12-4a26-90a2-ae336a750507', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44871ae8-0d91-40eb-a4b5-0d570fca1101', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:50:30 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-fe5e78d6-0dde-4383-8253-edfb6d7d36c8 req-34d526f3-e0bd-4011-8f6b-ad96736f28f8 tempest-ServerActionsTestOtherA-1146837832 None] attachment_update completed successfully. Sep 09 17:50:35 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=94,cinder:SELECT=93,cinder:DELETE=7,cinder:INSERT=22 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:50:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2a2d0811-4df9-463d-822a-64faffc2d811 tempest-GroupsTest-1604097675 None] Group tempest-Group1-1441061892: creating Sep 09 17:50:35 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=85,cinder:INSERT=30,cinder:UPDATE=80,cinder:DELETE=8 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:50:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2a2d0811-4df9-463d-822a-64faffc2d811 tempest-GroupsTest-1604097675 None] Group tempest-Group1-1441061892: created successfully Sep 09 17:50:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2a2d0811-4df9-463d-822a-64faffc2d811 tempest-GroupsTest-1604097675 None] Create group completed successfully. Sep 09 17:50:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0c0e1fdc-7423-472a-b2f6-93c6e1660958 tempest-GroupsTest-1604097675 None] Group tempest-Group2-1164165555: creating Sep 09 17:50:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0c0e1fdc-7423-472a-b2f6-93c6e1660958 tempest-GroupsTest-1604097675 None] Group tempest-Group2-1164165555: created successfully Sep 09 17:50:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0c0e1fdc-7423-472a-b2f6-93c6e1660958 tempest-GroupsTest-1604097675 None] Create group completed successfully. Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Flow 'volume_create_manager' (f159a921-c9e6-4162-807f-d40fecf62327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfad594d-3dbe-4b63-95ae-cb674b9d377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfad594d-3dbe-4b63-95ae-cb674b9d377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1529448488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8dba517e-6664-465a-a754-e5525e476bd6,host='devstack@QuobyteHD#QuobyteHD',id=3425c49c-e4c3-4986-b128-6609cb16446c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c38c438f07c4888bf9fe3774f37ccde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:40Z,use_quota=True,user_id='24afc405264c4cd1ae383fc69c342d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca35e5cd-5003-4d42-9fb0-43c971f28853),volume_type_id=ca35e5cd-5003-4d42-9fb0-43c971f28853)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cb73ae-0b3f-41ab-abd5-5d51d2affd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cb73ae-0b3f-41ab-abd5-5d51d2affd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cd0b4f-b30d-4b07-81f6-56ef5e40170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cd0b4f-b30d-4b07-81f6-56ef5e40170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3425c49c-e4c3-4986-b128-6609cb16446c', 'volume_name': 'volume-3425c49c-e4c3-4986-b128-6609cb16446c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a64a6d-f4db-4c2b-a3ab-b70e73e20d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a64a6d-f4db-4c2b-a3ab-b70e73e20d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a645639c-58d8-49a1-ad1a-108fecee2efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:40 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Volume 3425c49c-e4c3-4986-b128-6609cb16446c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3425c49c-e4c3-4986-b128-6609cb16446c', 'volume_size': 1} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8dba517e-6664-465a-a754-e5525e476bd6,created_at=2026-09-09T15:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1529448488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8dba517e-6664-465a-a754-e5525e476bd6,host='devstack@QuobyteHD#QuobyteHD',id=3425c49c-e4c3-4986-b128-6609cb16446c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c38c438f07c4888bf9fe3774f37ccde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:40Z,use_quota=True,user_id='24afc405264c4cd1ae383fc69c342d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca35e5cd-5003-4d42-9fb0-43c971f28853),volume_type_id=ca35e5cd-5003-4d42-9fb0-43c971f28853)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Creating volume 3425c49c-e4c3-4986-b128-6609cb16446c {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:50:40 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:50:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:40 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c 1073741824 Sep 09 17:50:40 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:41 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c 1073741824" returned: 0 in 0.762s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:41 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c Sep 09 17:50:41 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:41 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c" returned: 0 in 0.563s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a645639c-58d8-49a1-ad1a-108fecee2efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3425c49c-e4c3-4986-b128-6609cb16446c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b2b834-7e62-49d7-ac80-e46eeb7a05ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:41 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Volume volume-3425c49c-e4c3-4986-b128-6609cb16446c (3425c49c-e4c3-4986-b128-6609cb16446c): created successfully Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b2b834-7e62-49d7-ac80-e46eeb7a05ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Flow 'volume_create_manager' (f159a921-c9e6-4162-807f-d40fecf62327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b8165773-fb38-40a2-a6a0-b5fb2ea5191c tempest-GroupsTest-1604097675 None] Created volume successfully. Sep 09 17:50:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Acquiring lock "cinder-quobyte-3425c49c-e4c3-4986-b128-6609cb16446c" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Lock "cinder-quobyte-3425c49c-e4c3-4986-b128-6609cb16446c" acquired by "delete_volume" :: waited 0.043s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:45 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d57ebe-bd18-4b8f-b3c0-0bbe9f71f170]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:45 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c Sep 09 17:50:45 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:46 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c" returned: 0 in 0.802s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:46 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c Sep 09 17:50:46 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:46 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3425c49c-e4c3-4986-b128-6609cb16446c" returned: 0 in 0.498s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Lock "cinder-quobyte-3425c49c-e4c3-4986-b128-6609cb16446c" released by "delete_volume" :: held 1.496s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Created reservations ['6669f333-9c6d-4002-a59c-7548e4e24a83'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:50:46 devstack cinder-volume[87202]: WARNING cinder.quota [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2111376964 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2111376964, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:50:46 devstack cinder-volume[87202]: WARNING cinder.quota [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2111376964 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2111376964, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Created reservations ['4b4daa18-fbb1-4e82-81e5-7a0b073f1cf5', 'f5cd16e9-50a9-4738-9c20-b689c0ebca63', 'daf9bfd4-e3e1-4bd6-b2dd-7337e020b363', '92f7109c-04d1-4bb2-9c82-5ab0c283f0f3'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:47 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:50:47 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:47 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.313s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:47 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:50:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d6e7381d-a49d-4b37-b1df-385216b47667 tempest-GroupsTest-1604097675 None] Delete group completed successfully. Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Created reservations ['1ea8ce74-66e8-46be-bc1e-681ee28b8e38'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:48 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:50:48 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:48 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.462s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:48 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:50:48 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-31fe52e6-e9eb-4474-b920-f7311b1a6f9a tempest-GroupsTest-1604097675 None] Delete group completed successfully. Sep 09 17:50:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-59e6e493-27ca-400a-a8c8-9252e6426840 tempest-GroupsTest-1604097675 None] Group tempest-GroupsTest-Group-411316494: creating Sep 09 17:50:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-59e6e493-27ca-400a-a8c8-9252e6426840 tempest-GroupsTest-1604097675 None] Group tempest-GroupsTest-Group-411316494: created successfully Sep 09 17:50:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-59e6e493-27ca-400a-a8c8-9252e6426840 tempest-GroupsTest-1604097675 None] Create group completed successfully. Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Flow 'volume_create_manager' (072ec5c4-5117-49a0-8f0b-6ee8c6821188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa7ddea-ad37-4663-b0a7-4faa930f133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa7ddea-ad37-4663-b0a7-4faa930f133c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-268279571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a39053fd-c94e-4da9-90af-a1ced23b8675,host='devstack@QuobyteHD#QuobyteHD',id=853613ce-73c2-4457-90fa-1a87efb0d68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c38c438f07c4888bf9fe3774f37ccde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:52Z,use_quota=True,user_id='24afc405264c4cd1ae383fc69c342d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4024ffcc-1179-407e-b4cc-d91e1ce33180),volume_type_id=4024ffcc-1179-407e-b4cc-d91e1ce33180)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e480de8-9d58-4123-938d-c58928a9756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e480de8-9d58-4123-938d-c58928a9756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41b3f68-56cf-4ecb-8805-008d5a3372fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41b3f68-56cf-4ecb-8805-008d5a3372fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853613ce-73c2-4457-90fa-1a87efb0d68a', 'volume_name': 'volume-853613ce-73c2-4457-90fa-1a87efb0d68a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ee1738-e574-4f67-84f6-7f20fb84b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ee1738-e574-4f67-84f6-7f20fb84b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31dfb648-d806-44b1-8a27-bb8f9d353ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:52 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Volume 853613ce-73c2-4457-90fa-1a87efb0d68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853613ce-73c2-4457-90fa-1a87efb0d68a', 'volume_size': 1} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a39053fd-c94e-4da9-90af-a1ced23b8675,created_at=2026-09-09T15:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-268279571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a39053fd-c94e-4da9-90af-a1ced23b8675,host='devstack@QuobyteHD#QuobyteHD',id=853613ce-73c2-4457-90fa-1a87efb0d68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c38c438f07c4888bf9fe3774f37ccde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:52Z,use_quota=True,user_id='24afc405264c4cd1ae383fc69c342d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4024ffcc-1179-407e-b4cc-d91e1ce33180),volume_type_id=4024ffcc-1179-407e-b4cc-d91e1ce33180)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Creating volume 853613ce-73c2-4457-90fa-1a87efb0d68a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:50:52 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:52 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a 1073741824 Sep 09 17:50:52 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:52 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a 1073741824" returned: 0 in 0.653s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:52 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a Sep 09 17:50:52 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:53 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a" returned: 0 in 0.346s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:50:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31dfb648-d806-44b1-8a27-bb8f9d353ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853613ce-73c2-4457-90fa-1a87efb0d68a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c2b19f-b0d6-46ae-b4b6-a81ea6bebef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Volume volume-853613ce-73c2-4457-90fa-1a87efb0d68a (853613ce-73c2-4457-90fa-1a87efb0d68a): created successfully Sep 09 17:50:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c2b19f-b0d6-46ae-b4b6-a81ea6bebef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Flow 'volume_create_manager' (072ec5c4-5117-49a0-8f0b-6ee8c6821188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-aa967ae7-dc97-490d-b0b9-63171ad155b0 tempest-GroupsTest-1604097675 None] Created volume successfully. Sep 09 17:50:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Acquiring lock "cinder-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Lock "cinder-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Acquiring lock "cinder-quobyte-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Lock "cinder-quobyte-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e" acquired by "delete_volume" :: waited 0.035s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:50:54 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d414383-8aa4-49f1-aafb-7f85da74410f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:50:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:54 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e Sep 09 17:50:54 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:55 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e" returned: 0 in 0.591s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:50:55 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e Sep 09 17:50:55 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Flow 'volume_create_manager' (243e874f-22d3-4d7b-93ea-7b13a3192b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b79757-bd20-4ec1-951c-f9d6d494d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b79757-bd20-4ec1-951c-f9d6d494d296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-16952081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a39053fd-c94e-4da9-90af-a1ced23b8675,host='devstack@QuobyteHD#QuobyteHD',id=13207909-8e0a-4327-afb2-dbfa5018e225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c38c438f07c4888bf9fe3774f37ccde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:55Z,use_quota=True,user_id='24afc405264c4cd1ae383fc69c342d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4024ffcc-1179-407e-b4cc-d91e1ce33180),volume_type_id=4024ffcc-1179-407e-b4cc-d91e1ce33180)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7cb654-7843-4296-b6d1-c3840822c52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7cb654-7843-4296-b6d1-c3840822c52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ed694c-43ca-467f-9c0e-5f18ee8204ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ed694c-43ca-467f-9c0e-5f18ee8204ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13207909-8e0a-4327-afb2-dbfa5018e225', 'volume_name': 'volume-13207909-8e0a-4327-afb2-dbfa5018e225', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5aebf4-e2a3-4cd3-8016-7977a08b8abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5aebf4-e2a3-4cd3-8016-7977a08b8abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e888c96d-a2bb-4ff2-8e87-465540411e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Volume 13207909-8e0a-4327-afb2-dbfa5018e225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13207909-8e0a-4327-afb2-dbfa5018e225', 'volume_size': 1} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a39053fd-c94e-4da9-90af-a1ced23b8675,created_at=2026-09-09T15:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-16952081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a39053fd-c94e-4da9-90af-a1ced23b8675,host='devstack@QuobyteHD#QuobyteHD',id=13207909-8e0a-4327-afb2-dbfa5018e225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c38c438f07c4888bf9fe3774f37ccde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:50:55Z,use_quota=True,user_id='24afc405264c4cd1ae383fc69c342d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4024ffcc-1179-407e-b4cc-d91e1ce33180),volume_type_id=4024ffcc-1179-407e-b4cc-d91e1ce33180)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Creating volume 13207909-8e0a-4327-afb2-dbfa5018e225 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:50:55 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:55 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 1073741824 Sep 09 17:50:55 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:55 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Lock "cinder-quobyte-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e" released by "delete_volume" :: held 1.001s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Created reservations ['be0484a8-5087-4aee-b8ff-50f6ece598bf', '1369bb5f-39e3-475c-8ba3-535ab7e185ae', 'a1d70543-aec5-423c-b6a9-13c4900337e1', '04bf3ccb-a79f-4bf8-9631-465bb8ba90b0'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:55 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:50:55 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:56 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 1073741824" returned: 0 in 0.474s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:50:56 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 Sep 09 17:50:56 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:50:56 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:50:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Deleted volume successfully. Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f17d488b-ca85-451e-b046-dd2892985c02 tempest-VolumesNegativeTest-1144887638 None] Lock "cinder-0a04e2ed-53f2-493e-ac7b-0aba2b55c96e-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:50:56 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225" returned: 0 in 0.267s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e888c96d-a2bb-4ff2-8e87-465540411e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13207909-8e0a-4327-afb2-dbfa5018e225', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ee7038-1517-4712-a299-5e949945e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:50:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Volume volume-13207909-8e0a-4327-afb2-dbfa5018e225 (13207909-8e0a-4327-afb2-dbfa5018e225): created successfully Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ee7038-1517-4712-a299-5e949945e712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:50:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Flow 'volume_create_manager' (243e874f-22d3-4d7b-93ea-7b13a3192b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:50:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3bb6d9dd-363a-400c-ac7f-609cdf228f13 tempest-GroupsTest-1604097675 None] Created volume successfully. Sep 09 17:50:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-348db189-2548-4339-80a8-8122305b1108 tempest-GroupsTest-1604097675 None] Update group completed successfully. Sep 09 17:50:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-04458b64-5de2-41f2-9e8a-8147dbd027fa tempest-GroupsTest-1604097675 None] Update group completed successfully. Sep 09 17:50:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Acquiring lock "cinder-quobyte-13207909-8e0a-4327-afb2-dbfa5018e225" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:50:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Lock "cinder-quobyte-13207909-8e0a-4327-afb2-dbfa5018e225" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b87bc-6dad-452d-ba49-894773e6ff9d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:00 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 Sep 09 17:51:00 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:00 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225" returned: 0 in 0.475s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:00 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225 Sep 09 17:51:00 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:00 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-13207909-8e0a-4327-afb2-dbfa5018e225" returned: 0 in 0.286s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Lock "cinder-quobyte-13207909-8e0a-4327-afb2-dbfa5018e225" released by "delete_volume" :: held 0.824s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Acquiring lock "cinder-quobyte-853613ce-73c2-4457-90fa-1a87efb0d68a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Lock "cinder-quobyte-853613ce-73c2-4457-90fa-1a87efb0d68a" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603b20a-1e90-4dd1-a079-52f9997c5640]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:00 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a Sep 09 17:51:00 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:01 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a" returned: 0 in 0.411s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:01 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a Sep 09 17:51:01 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:01 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-853613ce-73c2-4457-90fa-1a87efb0d68a" returned: 0 in 0.282s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Lock "cinder-quobyte-853613ce-73c2-4457-90fa-1a87efb0d68a" released by "delete_volume" :: held 0.745s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Created reservations ['91aa67a7-f6a7-43b9-8dbe-a3510dfe5f26'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:01 devstack cinder-volume[87202]: WARNING cinder.quota [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-843786536 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-843786536, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:51:01 devstack cinder-volume[87202]: WARNING cinder.quota [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-843786536 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-843786536, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Created reservations ['1d3fbabc-e43d-4682-ab9b-eaf555c268f9', '538a62b7-d394-412f-8fbf-fbe4b2d44993', '70469b83-37cc-4ec2-82fb-114321ba4e68', '35142ad3-9bb0-4cb9-baf8-25536d1aae3f'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Created reservations ['65b8daa1-47c8-4909-ba29-6b89dbbebe7e', '334d45d7-ec0f-4628-adef-e1ab94068b37', 'd86b0555-57ed-4bea-9d05-10166997bbc2', '76f40d00-379c-47ff-8eae-93a44956f70a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:02 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:51:02 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:02 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.264s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:02 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:51:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1b180260-2973-4d24-8c7a-8d47e3050929 tempest-GroupsTest-1604097675 None] Delete group completed successfully. Sep 09 17:51:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:51:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:05 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:51:05 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:05 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.275s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:51:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:51:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:51:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:51:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-6cddf153-756f-4f1b-8b63-160da41bb0c1 tempest-ServerActionsTestOtherA-1146837832 None] Terminate volume connection completed successfully. Sep 09 17:51:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-6cddf153-756f-4f1b-8b63-160da41bb0c1 tempest-ServerActionsTestOtherA-1146837832 None] Deleting attachment 44871ae8-0d91-40eb-a4b5-0d570fca1101. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:51:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "cinder-8d930e7b-8b12-4a26-90a2-ae336a750507-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Lock "cinder-8d930e7b-8b12-4a26-90a2-ae336a750507-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "cinder-quobyte-8d930e7b-8b12-4a26-90a2-ae336a750507" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Lock "cinder-quobyte-8d930e7b-8b12-4a26-90a2-ae336a750507" acquired by "delete_volume" :: waited 0.041s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[967a8fa0-db60-43aa-bf04-83e2b3870089]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:12 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 Sep 09 17:51:12 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-cfd99c4f-4487-4095-a89d-4989659c6808 tempest-GroupsV314Test-120885344 None] Group tempest-GroupsV314Test-Group-774792384: creating Sep 09 17:51:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-cfd99c4f-4487-4095-a89d-4989659c6808 tempest-GroupsV314Test-120885344 None] Group tempest-GroupsV314Test-Group-774792384: created successfully Sep 09 17:51:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-cfd99c4f-4487-4095-a89d-4989659c6808 tempest-GroupsV314Test-120885344 None] Create group completed successfully. Sep 09 17:51:12 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507" returned: 0 in 0.525s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:12 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507 Sep 09 17:51:12 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:12 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d930e7b-8b12-4a26-90a2-ae336a750507" returned: 0 in 0.284s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Lock "cinder-quobyte-8d930e7b-8b12-4a26-90a2-ae336a750507" released by "delete_volume" :: held 0.896s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:12 devstack cinder-volume[87202]: DEBUG cinder.quota [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Created reservations ['d6e0cd1a-9fba-485e-8be2-2c0ba11fd18c', '716e1565-304c-4bfd-ba20-b5af97a032ff', 'b80b4988-d814-4a89-b728-4ada4607ddac', '9c2246f0-dbd5-4895-a9d1-e9a2cedede11'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:13 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:51:13 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "cinder-d17bc096-5f69-4426-8c5f-1173578870d1-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Lock "cinder-d17bc096-5f69-4426-8c5f-1173578870d1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "cinder-quobyte-d17bc096-5f69-4426-8c5f-1173578870d1" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Lock "cinder-quobyte-d17bc096-5f69-4426-8c5f-1173578870d1" acquired by "delete_volume" :: waited 0.043s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dc13a4-73c4-45ba-b082-2a71dbce7f3f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:13 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.330s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG cinder.manager [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:51:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Deleted volume successfully. Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-150e38d3-8315-480d-b9c6-ff631d5af8fd req-0e97a005-2ab5-4cc9-8b68-ac35a368c70f tempest-ServerActionsTestOtherA-1146837832 None] Lock "cinder-8d930e7b-8b12-4a26-90a2-ae336a750507-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:13 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 Sep 09 17:51:13 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:13 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1" returned: 0 in 0.560s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:13 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1 Sep 09 17:51:13 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Flow 'volume_create_manager' (bd320715-cfc2-4058-8d23-54b427f35537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81497042-d09c-4a25-ab43-7aa2765b2917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:14 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81497042-d09c-4a25-ab43-7aa2765b2917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1034203158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6615afe4-0c1f-40b4-99c5-57f41d5967bd,host='devstack@QuobyteHD#QuobyteHD',id=4aa60b55-9e9b-4176-886a-ebe15e0ff965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240caf87182e47248a385879690dfc62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:51:14Z,use_quota=True,user_id='12f62fa144c34df8b3755c9528e4838a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d76430d-0209-46ac-a16e-30fa9b05918d),volume_type_id=7d76430d-0209-46ac-a16e-30fa9b05918d)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ab3ce1-ba00-4d5f-bc82-f7130950ae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ab3ce1-ba00-4d5f-bc82-f7130950ae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e72c17-9e59-4d95-a3cc-e87daf23c594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e72c17-9e59-4d95-a3cc-e87daf23c594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa60b55-9e9b-4176-886a-ebe15e0ff965', 'volume_name': 'volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff4a476-eaab-4d15-845b-0254b5b38dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff4a476-eaab-4d15-845b-0254b5b38dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bea8ee-bfc7-44e1-843f-1e26a36889a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Volume 4aa60b55-9e9b-4176-886a-ebe15e0ff965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965', 'volume_size': 1} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6615afe4-0c1f-40b4-99c5-57f41d5967bd,created_at=2026-09-09T15:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1034203158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6615afe4-0c1f-40b4-99c5-57f41d5967bd,host='devstack@QuobyteHD#QuobyteHD',id=4aa60b55-9e9b-4176-886a-ebe15e0ff965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240caf87182e47248a385879690dfc62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:51:14Z,use_quota=True,user_id='12f62fa144c34df8b3755c9528e4838a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d76430d-0209-46ac-a16e-30fa9b05918d),volume_type_id=7d76430d-0209-46ac-a16e-30fa9b05918d)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Creating volume 4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:51:14 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d17bc096-5f69-4426-8c5f-1173578870d1" returned: 0 in 0.468s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:14 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 1073741824 Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Lock "cinder-quobyte-d17bc096-5f69-4426-8c5f-1173578870d1" released by "delete_volume" :: held 1.095s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:14 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Created reservations ['254ab02d-90eb-4e87-94e1-16bc6b8ee17b', '0a60cda1-f9d9-4382-a094-8b8d9e60f567', 'b86a6793-8bf5-4b2b-b597-f791e6fc4d57', '72d52035-8ca7-4a4e-883d-3471f13bedff'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:14 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:51:14 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:14 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.276s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:51:14 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Deleted volume successfully. Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a97bc1ae-c27c-4e8b-a002-1c7c07a251a3 tempest-ServerActionsTestOtherA-1146837832 None] Lock "cinder-d17bc096-5f69-4426-8c5f-1173578870d1-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:14 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 1073741824" returned: 0 in 0.566s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:14 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 Sep 09 17:51:14 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:15 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965" returned: 0 in 0.331s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:51:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bea8ee-bfc7-44e1-843f-1e26a36889a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3da0ba-ecfc-485d-9d20-4be10156adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:15 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Volume volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 (4aa60b55-9e9b-4176-886a-ebe15e0ff965): created successfully Sep 09 17:51:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3da0ba-ecfc-485d-9d20-4be10156adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Flow 'volume_create_manager' (bd320715-cfc2-4058-8d23-54b427f35537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:51:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-40d89e02-e1e5-499d-96bf-d9bf2aa6ee91 tempest-GroupsV314Test-120885344 None] Created volume successfully. Sep 09 17:51:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:16 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Cloning volume 4aa60b55-9e9b-4176-886a-ebe15e0ff965 to volume 5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 Sep 09 17:51:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Creating offline snapshot 6016a8de-3246-4f70-ae15-755e352619b5 of volume 4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:51:16 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8e8df4-ca96-4ff1-8929-94cca9595184]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:17 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 Sep 09 17:51:17 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-e9e2d795-8a52-4302-bd63-5bf22d82cd2d req-1f4c1ba1-81a4-40f4-86da-ad01b12ef1ca tempest-AttachVolumeNegativeTest-1931294304 None] Terminate volume connection completed successfully. Sep 09 17:51:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-e9e2d795-8a52-4302-bd63-5bf22d82cd2d req-1f4c1ba1-81a4-40f4-86da-ad01b12ef1ca tempest-AttachVolumeNegativeTest-1931294304 None] Deleting attachment 5ba5a26c-7dc5-4848-9b89-84bd7ddb4f2a. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:51:17 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965" returned: 0 in 0.785s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:17 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 1G Sep 09 17:51:17 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:18 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 1G" returned: 0 in 0.797s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:18 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 Sep 09 17:51:18 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:18 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5" returned: 0 in 0.499s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:18 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:51:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:18 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 Sep 09 17:51:18 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:19 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5" returned: 0 in 0.273s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:19 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.info Sep 09 17:51:19 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:19 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.info" returned: 0 in 0.321s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:19 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:51:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:19 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.info Sep 09 17:51:19 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:19 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.info" returned: 0 in 0.355s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Acquiring lock "cinder-quobyte-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Lock "cinder-quobyte-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] snapshot: 6016a8de-3246-4f70-ae15-755e352619b5, volume: 5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9404bf91-aec6-44b2-a14a-9973f3138e44]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:20 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 Sep 09 17:51:20 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:20 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5" returned: 0 in 0.446s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7cb08e-0883-430f-bb34-c216e87d8c79]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:20 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 Sep 09 17:51:20 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:20 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965" returned: 0 in 0.406s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:51:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:20 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 Sep 09 17:51:20 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:26 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" returned: 0 in 5.938s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:26 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:51:26 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Converted 1024.00 MB image at 172.41 MB/s Sep 09 17:51:26 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:51:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:26 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 Sep 09 17:51:26 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:27 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Lock "cinder-quobyte-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" released by "_copy_volume_from_snapshot" :: held 7.154s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Acquiring lock "cinder-quobyte-6016a8de-3246-4f70-ae15-755e352619b5" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Lock "cinder-quobyte-6016a8de-3246-4f70-ae15-755e352619b5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Deleting offline snapshot 6016a8de-3246-4f70-ae15-755e352619b5 of volume 4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] snapshot_file for this snap is: volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec77fb0-4048-4c56-914e-8b8a2f82e75f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:27 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 Sep 09 17:51:27 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:27 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5" returned: 0 in 0.453s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d32c5e-4ddc-469e-b092-b5f848f34315]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:27 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 Sep 09 17:51:27 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:28 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965" returned: 0 in 0.649s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:28 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 Sep 09 17:51:28 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:28 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5" returned: 0 in 0.385s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:28 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5 Sep 09 17:51:28 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:29 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965.6016a8de-3246-4f70-ae15-755e352619b5" returned: 0 in 0.339s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Lock "cinder-quobyte-6016a8de-3246-4f70-ae15-755e352619b5" released by "_delete_snapshot" :: held 1.970s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.542s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:29 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7cc55f74-c1fa-4781-90d5-6d85bddf3d68 tempest-GroupsV314Test-120885344 None] Create group from source-group-6615afe4-0c1f-40b4-99c5-57f41d5967bd completed successfully. Sep 09 17:51:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Acquiring lock "cinder-quobyte-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Lock "cinder-quobyte-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:30 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[478a6581-0d4f-47a2-8d8a-b65ea5f7ed00]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:30 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 Sep 09 17:51:30 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:31 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" returned: 0 in 0.412s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:31 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0 Sep 09 17:51:31 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:31 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" returned: 0 in 0.355s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Lock "cinder-quobyte-5cb6d387-dbc2-4e9e-9cc9-d7f682ab14f0" released by "delete_volume" :: held 0.840s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Created reservations ['29c192ac-48d5-4380-ba64-4b9cc9d540ea'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:31 devstack cinder-volume[87202]: WARNING cinder.quota [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-490330915 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-490330915, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:51:31 devstack cinder-volume[87202]: WARNING cinder.quota [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-490330915 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-490330915, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Created reservations ['4f689738-c8a6-4bea-80fa-2ee1da2fc3c7', '49659f5a-dd70-485d-ae8d-18be3ec3c484', '1bf6ab44-4d55-454b-8c6b-078c0d556dc7', 'd78f963c-400c-4b74-8e1e-bf338cdde8de'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:32 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:51:32 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Flow 'volume_create_manager' (6c983250-cb70-4d60-8ac8-324c8ef23409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3953a8-5040-486e-a564-86643cbca892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3953a8-5040-486e-a564-86643cbca892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1251718702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767ee2b1-cb4a-429e-97c3-e94c644885fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94538981ddf488ca5da733872ee7bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:51:32Z,use_quota=True,user_id='926615d0c88c4484ab3bb3e54d44e633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee4642f-65e3-4ce9-8d8a-f32e4cccfbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee4642f-65e3-4ce9-8d8a-f32e4cccfbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074c3fc3-946a-444e-9747-b086f1e4ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074c3fc3-946a-444e-9747-b086f1e4ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767ee2b1-cb4a-429e-97c3-e94c644885fd', 'volume_name': 'volume-767ee2b1-cb4a-429e-97c3-e94c644885fd', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a307821-63f6-4b22-99dc-b81ab5dd1336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a307821-63f6-4b22-99dc-b81ab5dd1336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d3c99e-31d8-497a-9669-9edb45e6b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:32 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Volume 767ee2b1-cb4a-429e-97c3-e94c644885fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767ee2b1-cb4a-429e-97c3-e94c644885fd', 'volume_size': 1} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1251718702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767ee2b1-cb4a-429e-97c3-e94c644885fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94538981ddf488ca5da733872ee7bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:51:32Z,use_quota=True,user_id='926615d0c88c4484ab3bb3e54d44e633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Creating volume 767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:51:32 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:32 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.328s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:51:32 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd 1073741824 Sep 09 17:51:32 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:32 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9e848bad-0d55-4ebb-a7d0-94607a37e388 tempest-GroupsV314Test-120885344 None] Delete group completed successfully. Sep 09 17:51:32 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd 1073741824" returned: 0 in 0.567s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:32 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd Sep 09 17:51:32 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:33 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd" returned: 0 in 0.292s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d3c99e-31d8-497a-9669-9edb45e6b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767ee2b1-cb4a-429e-97c3-e94c644885fd', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d001a0-110b-4646-b93f-2da16c15d833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:51:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Volume volume-767ee2b1-cb4a-429e-97c3-e94c644885fd (767ee2b1-cb4a-429e-97c3-e94c644885fd): created successfully Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d001a0-110b-4646-b93f-2da16c15d833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Flow 'volume_create_manager' (6c983250-cb70-4d60-8ac8-324c8ef23409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:51:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-048a849d-eb0c-4228-bc3a-ae50a30377b7 tempest-TestStampPattern-418754457 None] Created volume successfully. Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Acquiring lock "cinder-quobyte-4aa60b55-9e9b-4176-886a-ebe15e0ff965" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Lock "cinder-quobyte-4aa60b55-9e9b-4176-886a-ebe15e0ff965" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1b10b0-415e-44c9-856d-230b07210208]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:51:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:33 devstack sudo[93314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 Sep 09 17:51:33 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:34 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965" returned: 0 in 0.442s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:34 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965 Sep 09 17:51:34 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:34 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4aa60b55-9e9b-4176-886a-ebe15e0ff965" returned: 0 in 0.318s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Lock "cinder-quobyte-4aa60b55-9e9b-4176-886a-ebe15e0ff965" released by "delete_volume" :: held 0.836s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Created reservations ['89e08a6a-c5e4-49b0-9c74-42633be7d931'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Created reservations ['377ddf8b-467a-4a67-81c2-5a873e6c9ebb', '943fe43b-cf2a-48f0-b50f-abeb4a9829f1', '3fee61dd-9c60-40e8-a427-e9ca48773166', '4b98826a-fe99-4587-bc96-2cd6e4783aac'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:51:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:51:34 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:51:34 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:51:35 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Sep 09 17:51:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.351s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:51:35 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:51:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f8e09f9a-5163-4570-a7cf-85b9f0b3ef37 tempest-GroupsV314Test-120885344 None] Delete group completed successfully. Sep 09 17:51:37 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=103,cinder:SELECT=94,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:51:37 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=101,cinder:SELECT=79,cinder:INSERT=29,cinder:DELETE=2 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:52:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:52:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:05 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:52:05 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:05 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.411s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:52:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:52:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:52:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Flow 'volume_create_manager' (d0f2d9bd-c662-4911-90db-ef0494c24bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfd9c3f-77d3-44e4-8280-93fec9c23d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfd9c3f-77d3-44e4-8280-93fec9c23d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1522230520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41931d70-0416-4121-8a07-bd1fa8af1ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c80cf4246a124c809677d6edbbd5dd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:16Z,use_quota=True,user_id='57a42e7c8acf470c9950c06263402967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd69f0a-c96e-422b-9a40-1eb6da629e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd69f0a-c96e-422b-9a40-1eb6da629e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22eff1c-788c-4f49-b3bb-385c5f2ba011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22eff1c-788c-4f49-b3bb-385c5f2ba011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41931d70-0416-4121-8a07-bd1fa8af1ece', 'volume_name': 'volume-41931d70-0416-4121-8a07-bd1fa8af1ece', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c910b8-84b9-450c-899d-826e3c1e0623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c910b8-84b9-450c-899d-826e3c1e0623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38464dda-2fee-4b40-801e-b6b475fb7322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:16 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Volume 41931d70-0416-4121-8a07-bd1fa8af1ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41931d70-0416-4121-8a07-bd1fa8af1ece', 'volume_size': 1} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1522230520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41931d70-0416-4121-8a07-bd1fa8af1ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c80cf4246a124c809677d6edbbd5dd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:16Z,use_quota=True,user_id='57a42e7c8acf470c9950c06263402967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Creating volume 41931d70-0416-4121-8a07-bd1fa8af1ece {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:52:16 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:52:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:16 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece 1073741824 Sep 09 17:52:16 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-031b1cd1-4a9f-4723-b0ef-4f8f79a00bd6 req-d00c9651-27f7-441d-b280-2a7b19906b0a tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:17 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece 1073741824" returned: 0 in 0.845s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:17 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece Sep 09 17:52:17 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:17 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece" returned: 0 in 0.503s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-031b1cd1-4a9f-4723-b0ef-4f8f79a00bd6 req-d00c9651-27f7-441d-b280-2a7b19906b0a tempest-TestStampPattern-418754457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.774s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-031b1cd1-4a9f-4723-b0ef-4f8f79a00bd6 req-d00c9651-27f7-441d-b280-2a7b19906b0a tempest-TestStampPattern-418754457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.066s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38464dda-2fee-4b40-801e-b6b475fb7322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41931d70-0416-4121-8a07-bd1fa8af1ece', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0126a0-cb1f-42bc-8415-66e83f861b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:17 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Volume volume-41931d70-0416-4121-8a07-bd1fa8af1ece (41931d70-0416-4121-8a07-bd1fa8af1ece): created successfully Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0126a0-cb1f-42bc-8415-66e83f861b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Flow 'volume_create_manager' (d0f2d9bd-c662-4911-90db-ef0494c24bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-77af7fde-3207-4eb1-a651-85f9e7b73ccc tempest-ServerRescueNegativeTestJSON-1777114939 None] Created volume successfully. Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-031b1cd1-4a9f-4723-b0ef-4f8f79a00bd6 req-d00c9651-27f7-441d-b280-2a7b19906b0a tempest-TestStampPattern-418754457 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-767ee2b1-cb4a-429e-97c3-e94c644885fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd818be45-ac56-4be4-b836-d087dd54b8a3', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Flow 'volume_create_manager' (244990b8-f620-4b17-9800-91db3b9f981c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9a3925-355b-422e-ba3b-4d9a49557551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9a3925-355b-422e-ba3b-4d9a49557551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1045894524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a1cd05-072c-48ef-ab98-dc720309186e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f85e14870e44be3b959e53308cf6e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:18Z,use_quota=True,user_id='f3a8f4091a9a4e6ea1ac0a887cb88e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915800bf-11f9-468f-abfd-502eef783ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915800bf-11f9-468f-abfd-502eef783ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48013cc1-55e2-4324-b59f-b40852add259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48013cc1-55e2-4324-b59f-b40852add259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a1cd05-072c-48ef-ab98-dc720309186e', 'volume_name': 'volume-77a1cd05-072c-48ef-ab98-dc720309186e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a3bab1-a4c2-4332-89a6-7c02b366d38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a3bab1-a4c2-4332-89a6-7c02b366d38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be6f676-40c8-44f4-bdd6-6b0ee4c8b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:18 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Volume 77a1cd05-072c-48ef-ab98-dc720309186e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a1cd05-072c-48ef-ab98-dc720309186e', 'volume_size': 1} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1045894524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a1cd05-072c-48ef-ab98-dc720309186e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f85e14870e44be3b959e53308cf6e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:18Z,use_quota=True,user_id='f3a8f4091a9a4e6ea1ac0a887cb88e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Creating volume 77a1cd05-072c-48ef-ab98-dc720309186e {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:52:18 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:52:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:18 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e 1073741824 Sep 09 17:52:18 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:18 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-031b1cd1-4a9f-4723-b0ef-4f8f79a00bd6 req-d00c9651-27f7-441d-b280-2a7b19906b0a tempest-TestStampPattern-418754457 None] attachment_update completed successfully. Sep 09 17:52:19 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e 1073741824" returned: 0 in 1.095s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:19 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e Sep 09 17:52:19 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:19 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e" returned: 0 in 0.427s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be6f676-40c8-44f4-bdd6-6b0ee4c8b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a1cd05-072c-48ef-ab98-dc720309186e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e21e02f-3eed-4930-aa76-450c4330a883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:19 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Volume volume-77a1cd05-072c-48ef-ab98-dc720309186e (77a1cd05-072c-48ef-ab98-dc720309186e): created successfully Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e21e02f-3eed-4930-aa76-450c4330a883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Flow 'volume_create_manager' (244990b8-f620-4b17-9800-91db3b9f981c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3691ec8d-9dc8-43a9-91a0-0d5e821da588 tempest-AttachVolumeNegativeTest-1931294304 None] Created volume successfully. Sep 09 17:52:20 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Flow 'volume_create_manager' (ebc58112-f137-415b-b06e-4bb00fb99af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3dc8b8-813e-432d-b3eb-8764d57e3e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b3dc8b8-813e-432d-b3eb-8764d57e3e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-393267072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17007eb7-a932-43a2-9a02-3d7ab2d17a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3be55351f43878370e9e75a30f4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:21Z,use_quota=True,user_id='3be72c55cf3244438da017455e2418c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1655244-c19c-42e9-ab1c-54506df8da51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1655244-c19c-42e9-ab1c-54506df8da51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97e68c8-84cd-4319-8857-76fe26ad6f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97e68c8-84cd-4319-8857-76fe26ad6f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17007eb7-a932-43a2-9a02-3d7ab2d17a62', 'volume_name': 'volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f79190a-dbac-4d38-b0fe-db5042ce1b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f79190a-dbac-4d38-b0fe-db5042ce1b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adbd547-8e27-4279-927d-54f988f50a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:21 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Volume 17007eb7-a932-43a2-9a02-3d7ab2d17a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62', 'volume_size': 1} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-393267072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17007eb7-a932-43a2-9a02-3d7ab2d17a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b3be55351f43878370e9e75a30f4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:21Z,use_quota=True,user_id='3be72c55cf3244438da017455e2418c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Creating volume 17007eb7-a932-43a2-9a02-3d7ab2d17a62 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:52:21 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:21 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 1073741824 Sep 09 17:52:21 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:21 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 1073741824" returned: 0 in 0.653s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:21 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 Sep 09 17:52:21 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-2f7bdec9-4b03-4804-ada2-9257768cc2d2 req-482ad120-05c2-45da-9665-6e2db90bdb2f tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:22 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62" returned: 0 in 0.330s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-2f7bdec9-4b03-4804-ada2-9257768cc2d2 req-482ad120-05c2-45da-9665-6e2db90bdb2f tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.276s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7adbd547-8e27-4279-927d-54f988f50a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5878531d-e31f-42b0-9bb0-a2558ea971b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-2f7bdec9-4b03-4804-ada2-9257768cc2d2 req-482ad120-05c2-45da-9665-6e2db90bdb2f tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:22 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Volume volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 (17007eb7-a932-43a2-9a02-3d7ab2d17a62): created successfully Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5878531d-e31f-42b0-9bb0-a2558ea971b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Flow 'volume_create_manager' (ebc58112-f137-415b-b06e-4bb00fb99af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-261088ca-cf3e-4a28-88a1-dbb707380832 tempest-VolumesServicesTestJSON-1998312054 None] Created volume successfully. Sep 09 17:52:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-2f7bdec9-4b03-4804-ada2-9257768cc2d2 req-482ad120-05c2-45da-9665-6e2db90bdb2f tempest-AttachVolumeNegativeTest-1931294304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-77a1cd05-072c-48ef-ab98-dc720309186e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '799556b1-af79-444f-93c7-dc050fec6eb3', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:52:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-2f7bdec9-4b03-4804-ada2-9257768cc2d2 req-482ad120-05c2-45da-9665-6e2db90bdb2f tempest-AttachVolumeNegativeTest-1931294304 None] attachment_update completed successfully. Sep 09 17:52:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Acquiring lock "cinder-17007eb7-a932-43a2-9a02-3d7ab2d17a62-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:52:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Lock "cinder-17007eb7-a932-43a2-9a02-3d7ab2d17a62-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:52:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Acquiring lock "cinder-quobyte-17007eb7-a932-43a2-9a02-3d7ab2d17a62" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:52:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Lock "cinder-quobyte-17007eb7-a932-43a2-9a02-3d7ab2d17a62" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:52:23 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b64ea82-7773-4667-854e-5c2951663d92]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:52:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:23 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 Sep 09 17:52:23 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:24 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62" returned: 0 in 0.548s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:24 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62 Sep 09 17:52:24 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:24 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-17007eb7-a932-43a2-9a02-3d7ab2d17a62" returned: 0 in 0.335s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Lock "cinder-quobyte-17007eb7-a932-43a2-9a02-3d7ab2d17a62" released by "delete_volume" :: held 0.952s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Created reservations ['83adc284-8280-4973-8cb1-e46a142d81c7', '3595516f-ffb7-4a8e-82a2-c7ef3c6d312f', '60e2b779-9c66-42d0-911d-a0f28cc5688b', '55b3eae2-cf09-4cc2-8753-dabdcb18a9ec'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:24 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:52:24 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:25 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-304062b8-d746-4a77-a69e-3eb1270b944c req-224b830f-5962-4445-b60c-730d01a13d65 tempest-AttachVolumeNegativeTest-1931294304 None] Terminate volume connection completed successfully. Sep 09 17:52:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-304062b8-d746-4a77-a69e-3eb1270b944c req-224b830f-5962-4445-b60c-730d01a13d65 tempest-AttachVolumeNegativeTest-1931294304 None] Deleting attachment 799556b1-af79-444f-93c7-dc050fec6eb3. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:52:25 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.449s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:25 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:52:25 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Deleted volume successfully. Sep 09 17:52:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b1cf27dc-9603-4150-82f2-8a7da19d4657 tempest-VolumesServicesTestJSON-1998312054 None] Lock "cinder-17007eb7-a932-43a2-9a02-3d7ab2d17a62-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:52:25 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-d04c53fe-af49-4889-ab26-7ac9ff9bf935 req-15c37110-85d7-4a60-97ab-4f46698bc5fd tempest-TestStampPattern-418754457 None] Terminate volume connection completed successfully. Sep 09 17:52:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-d04c53fe-af49-4889-ab26-7ac9ff9bf935 req-15c37110-85d7-4a60-97ab-4f46698bc5fd tempest-TestStampPattern-418754457 None] Deleting attachment d818be45-ac56-4be4-b836-d087dd54b8a3. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:52:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Creating offline snapshot 54dabac6-f55b-441f-8f3d-3eeaac6ed315 of volume 767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:52:27 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[882b5cf3-6e0c-4619-8ee7-1c0819b8a75e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:52:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:27 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd Sep 09 17:52:27 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:28 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd" returned: 0 in 0.889s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:28 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 1G Sep 09 17:52:28 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:29 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 1G" returned: 0 in 0.861s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767ee2b1-cb4a-429e-97c3-e94c644885fd -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:29 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767ee2b1-cb4a-429e-97c3-e94c644885fd -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 Sep 09 17:52:29 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:29 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767ee2b1-cb4a-429e-97c3-e94c644885fd -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315" returned: 0 in 0.556s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:29 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 is being set with open permissions: ugo+rw Sep 09 17:52:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:29 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 Sep 09 17:52:29 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:30 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315" returned: 0 in 0.608s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:30 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.info Sep 09 17:52:30 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:31 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.info" returned: 0 in 0.420s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:31 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.info is being set with open permissions: ugo+rw Sep 09 17:52:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:31 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.info Sep 09 17:52:31 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:31 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.info" returned: 0 in 0.425s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.020s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:31 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-136fa0cf-86a8-4dc1-b4c8-c7032dbd5d74 tempest-TestStampPattern-418754457 None] Create snapshot completed successfully Sep 09 17:52:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Acquiring lock "cinder-41931d70-0416-4121-8a07-bd1fa8af1ece-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:52:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "cinder-41931d70-0416-4121-8a07-bd1fa8af1ece-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:52:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Acquiring lock "cinder-quobyte-41931d70-0416-4121-8a07-bd1fa8af1ece" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:52:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "cinder-quobyte-41931d70-0416-4121-8a07-bd1fa8af1ece" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:52:32 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[62461934-1674-4a0c-8884-c35b8c48e375]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:52:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:32 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece Sep 09 17:52:32 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:32 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece" returned: 0 in 0.628s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:32 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece Sep 09 17:52:32 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:33 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-41931d70-0416-4121-8a07-bd1fa8af1ece" returned: 0 in 0.425s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "cinder-quobyte-41931d70-0416-4121-8a07-bd1fa8af1ece" released by "delete_volume" :: held 1.120s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Created reservations ['3a84795e-bc11-4575-955d-13a3a6a70971', '9b3a3e3a-c225-4f33-a05c-ecbf0fdadf98', '9dbc07bc-60cc-408a-8614-91b151edce22', '12a528bf-69c7-43ca-badb-7343c3bc8ddd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:33 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:52:33 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:34 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.635s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:34 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:52:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Deleted volume successfully. Sep 09 17:52:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bed20681-ca1e-4ce8-83d3-39e8ff2a955b tempest-ServerRescueNegativeTestJSON-1777114939 None] Lock "cinder-41931d70-0416-4121-8a07-bd1fa8af1ece-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:52:43 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=35,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Flow 'volume_create_manager' (80621273-2430-42a1-a19e-16e88b929d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0eac33e-d653-4602-8bac-ddbd930bc69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0eac33e-d653-4602-8bac-ddbd930bc69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-917811628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b089f20f-dcf7-4076-baa5-71c2577e7aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94538981ddf488ca5da733872ee7bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54dabac6-f55b-441f-8f3d-3eeaac6ed315,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:44Z,use_quota=True,user_id='926615d0c88c4484ab3bb3e54d44e633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206efbff-3a44-44a5-8f28-724e244d3e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206efbff-3a44-44a5-8f28-724e244d3e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a0d108-e165-40da-b5b6-d3152f0f0987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a0d108-e165-40da-b5b6-d3152f0f0987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b089f20f-dcf7-4076-baa5-71c2577e7aeb', 'volume_name': 'volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb', 'volume_size': 1, 'snapshot_id': '54dabac6-f55b-441f-8f3d-3eeaac6ed315'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a591ed53-df81-4742-b8d7-b88bc37867bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a591ed53-df81-4742-b8d7-b88bc37867bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fe7f4b-a912-4e5d-8e07-7191b0f54a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:44 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Volume b089f20f-dcf7-4076-baa5-71c2577e7aeb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb', 'volume_size': 1, 'snapshot_id': '54dabac6-f55b-441f-8f3d-3eeaac6ed315'} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-quobyte-54dabac6-f55b-441f-8f3d-3eeaac6ed315-b089f20f-dcf7-4076-baa5-71c2577e7aeb" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-54dabac6-f55b-441f-8f3d-3eeaac6ed315-b089f20f-dcf7-4076-baa5-71c2577e7aeb" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Creating volume b089f20f-dcf7-4076-baa5-71c2577e7aeb from snapshot 54dabac6-f55b-441f-8f3d-3eeaac6ed315 {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-quobyte-b089f20f-dcf7-4076-baa5-71c2577e7aeb" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-b089f20f-dcf7-4076-baa5-71c2577e7aeb" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] snapshot: 54dabac6-f55b-441f-8f3d-3eeaac6ed315, volume: b089f20f-dcf7-4076-baa5-71c2577e7aeb, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7445acc2-5d8b-4807-9660-d871080630db]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:44 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 Sep 09 17:52:44 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:44 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315" returned: 0 in 0.476s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-767ee2b1-cb4a-429e-97c3-e94c644885fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d202d31-ba8d-41aa-a5a4-c7cb38f9927a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:52:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:45 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd Sep 09 17:52:45 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:45 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd" returned: 0 in 0.511s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:52:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:52:45 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:52:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:45 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb Sep 09 17:52:45 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Flow 'volume_create_manager' (2f617ca0-2a04-4b0f-b1b5-ea56dc01b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ac46e2-e640-472c-800b-169da817a106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ac46e2-e640-472c-800b-169da817a106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-690341798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1ab682-9422-414f-bfc8-df01c2fdf8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa9a068914e470a8ca5b2cfd7b51b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:51Z,use_quota=True,user_id='b8d0758f44a44efda6733e34b8571a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8c8a88-05dc-4b73-a581-15d005414d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8c8a88-05dc-4b73-a581-15d005414d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a0e65b-425e-4f3e-a887-5ccada7e666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a0e65b-425e-4f3e-a887-5ccada7e666a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1ab682-9422-414f-bfc8-df01c2fdf8c1', 'volume_name': 'volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026b484c-4a7e-4072-8f57-a0f06489d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026b484c-4a7e-4072-8f57-a0f06489d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39af13c-7c71-4e39-b284-7caae4dc0811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:51 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Volume 0e1ab682-9422-414f-bfc8-df01c2fdf8c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1', 'volume_size': 1} Sep 09 17:52:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:54 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb" returned: 0 in 8.739s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:52:54 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Converted 1024.00 MB image at 117.16 MB/s Sep 09 17:52:54 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb is being set with open permissions: ugo+rw Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:54 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb Sep 09 17:52:54 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:54 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb" returned: 0 in 0.664s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-b089f20f-dcf7-4076-baa5-71c2577e7aeb" released by "_copy_volume_from_snapshot" :: held 10.535s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-54dabac6-f55b-441f-8f3d-3eeaac6ed315-b089f20f-dcf7-4076-baa5-71c2577e7aeb" released by "_create_volume_from_snapshot" :: held 10.660s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.684s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.222s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-690341798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1ab682-9422-414f-bfc8-df01c2fdf8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa9a068914e470a8ca5b2cfd7b51b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:51Z,use_quota=True,user_id='b8d0758f44a44efda6733e34b8571a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Creating volume 0e1ab682-9422-414f-bfc8-df01c2fdf8c1 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:52:54 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:52:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5fe7f4b-a912-4e5d-8e07-7191b0f54a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb', 'volume_size': 1, 'snapshot_id': '54dabac6-f55b-441f-8f3d-3eeaac6ed315'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:55 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 1073741824 Sep 09 17:52:55 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c8fe2f-1ab2-497d-a4eb-f8d6d192997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Volume volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb (b089f20f-dcf7-4076-baa5-71c2577e7aeb): created successfully Sep 09 17:52:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c8fe2f-1ab2-497d-a4eb-f8d6d192997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Flow 'volume_create_manager' (80621273-2430-42a1-a19e-16e88b929d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0b61e826-e4b2-451b-8bab-ceac0d26d44b tempest-TestStampPattern-418754457 None] Created volume successfully. Sep 09 17:52:55 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 1073741824" returned: 0 in 1.037s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:56 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 Sep 09 17:52:56 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:52:56 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 09 17:52:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1" returned: 0 in 0.799s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:52:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:52:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39af13c-7c71-4e39-b284-7caae4dc0811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e41a1b2-41ed-4afd-baa8-2f21c0b7d6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Volume volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 (0e1ab682-9422-414f-bfc8-df01c2fdf8c1): created successfully Sep 09 17:52:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e41a1b2-41ed-4afd-baa8-2f21c0b7d6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Flow 'volume_create_manager' (2f617ca0-2a04-4b0f-b1b5-ea56dc01b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e63e3ceb-503e-4e7f-a50f-847e1203291c tempest-VolumesListAdminTestJSON-1561971987 None] Created volume successfully. Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Flow 'volume_create_manager' (ce43f4f7-bc90-4da8-beeb-5f2d0096fe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7152eb83-41c8-4ee2-8e4a-3880f0c3c359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7152eb83-41c8-4ee2-8e4a-3880f0c3c359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1830381691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aa3563-1af8-407e-a854-e04b7a711ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa9a068914e470a8ca5b2cfd7b51b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:59Z,use_quota=True,user_id='b8d0758f44a44efda6733e34b8571a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22943fd1-9451-4538-866e-f9e385557933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22943fd1-9451-4538-866e-f9e385557933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fba623d-2f0a-4261-81a1-6b5dffc6f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fba623d-2f0a-4261-81a1-6b5dffc6f886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73aa3563-1af8-407e-a854-e04b7a711ec2', 'volume_name': 'volume-73aa3563-1af8-407e-a854-e04b7a711ec2', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f856ad90-a996-45f1-b877-3150791fab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f856ad90-a996-45f1-b877-3150791fab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cc63eb-85f8-4072-86d6-8b58c2d3e134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:52:59 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Volume 73aa3563-1af8-407e-a854-e04b7a711ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73aa3563-1af8-407e-a854-e04b7a711ec2', 'volume_size': 1} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1830381691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73aa3563-1af8-407e-a854-e04b7a711ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa9a068914e470a8ca5b2cfd7b51b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:52:59Z,use_quota=True,user_id='b8d0758f44a44efda6733e34b8571a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Creating volume 73aa3563-1af8-407e-a854-e04b7a711ec2 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:52:59 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:52:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:52:59 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 1073741824 Sep 09 17:52:59 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:00 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 1073741824" returned: 0 in 1.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:01 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 Sep 09 17:53:01 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:01 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2" returned: 0 in 0.511s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:53:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71cc63eb-85f8-4072-86d6-8b58c2d3e134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73aa3563-1af8-407e-a854-e04b7a711ec2', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068a7f4e-9bb8-41b6-949d-aaeb70411e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:01 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Volume volume-73aa3563-1af8-407e-a854-e04b7a711ec2 (73aa3563-1af8-407e-a854-e04b7a711ec2): created successfully Sep 09 17:53:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068a7f4e-9bb8-41b6-949d-aaeb70411e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Flow 'volume_create_manager' (ce43f4f7-bc90-4da8-beeb-5f2d0096fe9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8a33b7b8-6840-4b8d-bf81-d864a6b4b2e8 tempest-VolumesListAdminTestJSON-1561971987 None] Created volume successfully. Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Flow 'volume_create_manager' (2c2e0a4c-d704-4264-a2f9-e26bb105f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beee06b0-0c4a-4be4-ad83-70610b06749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beee06b0-0c4a-4be4-ad83-70610b06749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1661551509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0794c83d-aacf-428a-b465-9ccd7786cb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa9a068914e470a8ca5b2cfd7b51b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:04Z,use_quota=True,user_id='b8d0758f44a44efda6733e34b8571a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d76bc84-7ebf-4e51-b212-275d4106f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d76bc84-7ebf-4e51-b212-275d4106f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b5b868-b29d-47ae-a33b-2b0a72a8376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b5b868-b29d-47ae-a33b-2b0a72a8376f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0794c83d-aacf-428a-b465-9ccd7786cb88', 'volume_name': 'volume-0794c83d-aacf-428a-b465-9ccd7786cb88', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3621a7-61c5-485e-a3a7-57201f523e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3621a7-61c5-485e-a3a7-57201f523e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf6f44c-f4d5-4ca5-92d4-1e0ae5d4cb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:03 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Volume 0794c83d-aacf-428a-b465-9ccd7786cb88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0794c83d-aacf-428a-b465-9ccd7786cb88', 'volume_size': 1} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1661551509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0794c83d-aacf-428a-b465-9ccd7786cb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa9a068914e470a8ca5b2cfd7b51b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:04Z,use_quota=True,user_id='b8d0758f44a44efda6733e34b8571a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Creating volume 0794c83d-aacf-428a-b465-9ccd7786cb88 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:53:03 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:53:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:03 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 1073741824 Sep 09 17:53:03 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:04 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 1073741824" returned: 0 in 0.759s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:04 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 Sep 09 17:53:04 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:53:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:05 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:05 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:05 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88" returned: 0 in 0.536s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf6f44c-f4d5-4ca5-92d4-1e0ae5d4cb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0794c83d-aacf-428a-b465-9ccd7786cb88', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2428f435-67bb-4651-bbf3-28cb1db075d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:05 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Volume volume-0794c83d-aacf-428a-b465-9ccd7786cb88 (0794c83d-aacf-428a-b465-9ccd7786cb88): created successfully Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2428f435-67bb-4651-bbf3-28cb1db075d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Flow 'volume_create_manager' (2c2e0a4c-d704-4264-a2f9-e26bb105f251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d3714159-99cd-4b20-b125-d4ca97bffe6a tempest-VolumesListAdminTestJSON-1561971987 None] Created volume successfully. Sep 09 17:53:05 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.380s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:53:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:53:06 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Flow 'volume_create_manager' (1f1eaaef-cf18-4f1e-969a-a052bb72ac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b77df5d-c03d-40b3-af26-a46a557be27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b77df5d-c03d-40b3-af26-a46a557be27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0609b81-7af7-4d0e-aef3-073a70b1994c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4896cc6356d644fb9ea00cbe683e0d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:07Z,use_quota=True,user_id='c853f8f4b7ce4148958b19f5d72c8455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ef6aad-c85b-4be1-a2e7-9e561e1d3f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ef6aad-c85b-4be1-a2e7-9e561e1d3f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafdfe72-d111-44ba-b13f-36c60bf2e26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafdfe72-d111-44ba-b13f-36c60bf2e26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0609b81-7af7-4d0e-aef3-073a70b1994c', 'volume_name': 'volume-d0609b81-7af7-4d0e-aef3-073a70b1994c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4888ec-b1a3-43d1-87c2-aef87f413366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4888ec-b1a3-43d1-87c2-aef87f413366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bbabb9-ca81-4c9c-8409-dce405b088a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:07 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Volume d0609b81-7af7-4d0e-aef3-073a70b1994c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0609b81-7af7-4d0e-aef3-073a70b1994c', 'volume_size': 1} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0609b81-7af7-4d0e-aef3-073a70b1994c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4896cc6356d644fb9ea00cbe683e0d9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:07Z,use_quota=True,user_id='c853f8f4b7ce4148958b19f5d72c8455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Creating volume d0609b81-7af7-4d0e-aef3-073a70b1994c {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:53:07 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:07 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c 1073741824 Sep 09 17:53:07 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:07 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c 1073741824" returned: 0 in 0.533s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:07 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c Sep 09 17:53:07 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:08 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:53:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bbabb9-ca81-4c9c-8409-dce405b088a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0609b81-7af7-4d0e-aef3-073a70b1994c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54049f62-1968-478d-8080-b78c2b506906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:08 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Volume volume-d0609b81-7af7-4d0e-aef3-073a70b1994c (d0609b81-7af7-4d0e-aef3-073a70b1994c): created successfully Sep 09 17:53:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54049f62-1968-478d-8080-b78c2b506906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Flow 'volume_create_manager' (1f1eaaef-cf18-4f1e-969a-a052bb72ac48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:08 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=48,cinder:SELECT=45,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:53:08 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a1a3724e-9411-43d4-a9b8-e58299c2c342 tempest-VolumesListAdminTestJSON-1299030146 None] Created volume successfully. Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Acquiring lock "cinder-d0609b81-7af7-4d0e-aef3-073a70b1994c-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Lock "cinder-d0609b81-7af7-4d0e-aef3-073a70b1994c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Acquiring lock "cinder-quobyte-d0609b81-7af7-4d0e-aef3-073a70b1994c" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Lock "cinder-quobyte-d0609b81-7af7-4d0e-aef3-073a70b1994c" acquired by "delete_volume" :: waited 0.032s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[36249223-d065-46ee-906b-348be19cbbaf]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "cinder-0794c83d-aacf-428a-b465-9ccd7786cb88-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-0794c83d-aacf-428a-b465-9ccd7786cb88-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:09 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c Sep 09 17:53:09 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "cinder-quobyte-0794c83d-aacf-428a-b465-9ccd7786cb88" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-quobyte-0794c83d-aacf-428a-b465-9ccd7786cb88" acquired by "delete_volume" :: waited 0.067s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ead470-b204-46d7-81cb-e356125455ac]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:10 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c" returned: 0 in 0.603s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:10 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 Sep 09 17:53:10 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:10 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c Sep 09 17:53:10 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:10 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d0609b81-7af7-4d0e-aef3-073a70b1994c" returned: 0 in 0.451s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:10 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Lock "cinder-quobyte-d0609b81-7af7-4d0e-aef3-073a70b1994c" released by "delete_volume" :: held 1.158s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88" returned: 0 in 0.667s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:10 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88 Sep 09 17:53:10 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:10 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Created reservations ['a22c6771-4eb0-40d5-8a46-bf55e370e9c5', 'd49226ee-f968-4f92-9a2b-7d90a9624b7d', 'f1d34d8e-14f8-4cab-91a7-8f883395fc33', '204b9857-f1ec-418a-b9c9-c7f9173ec4a7'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:11 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:11 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:11 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0794c83d-aacf-428a-b465-9ccd7786cb88" returned: 0 in 0.558s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-quobyte-0794c83d-aacf-428a-b465-9ccd7786cb88" released by "delete_volume" :: held 1.328s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Created reservations ['f0a41a93-6bd8-4e18-b343-938a6b30ba92', 'c22e966d-3b14-4893-85e8-da443a9a6f4c', '082126b1-a3ec-4e5f-9996-bd6e8d0e7abf', '0f0b4660-1521-44a7-a7b0-8469c813836a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:11 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.478s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Deleted volume successfully. Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a492104-9630-493a-962c-49bbda69bb1a tempest-VolumesListAdminTestJSON-1299030146 None] Lock "cinder-d0609b81-7af7-4d0e-aef3-073a70b1994c-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:11 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:11 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:12 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.462s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Deleted volume successfully. Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f20564c7-7a65-431e-9eb3-de0d1cc68b88 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-0794c83d-aacf-428a-b465-9ccd7786cb88-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "cinder-73aa3563-1af8-407e-a854-e04b7a711ec2-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-73aa3563-1af8-407e-a854-e04b7a711ec2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "cinder-quobyte-73aa3563-1af8-407e-a854-e04b7a711ec2" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-quobyte-73aa3563-1af8-407e-a854-e04b7a711ec2" acquired by "delete_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[78765871-3aea-43e2-9deb-bd0dc9804729]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:12 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 Sep 09 17:53:12 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Flow 'volume_create_manager' (f30aaee3-304c-43b4-90bd-f74eb554106f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077586c0-5e2d-4c3b-b1e5-7d9cb27623f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077586c0-5e2d-4c3b-b1e5-7d9cb27623f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1843547320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8704ae16-7fce-41c5-a4fe-5a1463f251e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f85e14870e44be3b959e53308cf6e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:13Z,use_quota=True,user_id='f3a8f4091a9a4e6ea1ac0a887cb88e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a3a9af-a043-44b0-9ddd-7a03675b22b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a3a9af-a043-44b0-9ddd-7a03675b22b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071d40cd-734a-4c78-aa58-cfd582191788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071d40cd-734a-4c78-aa58-cfd582191788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8704ae16-7fce-41c5-a4fe-5a1463f251e5', 'volume_name': 'volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacc47ba-aec7-410a-90ad-0ffb0e6e3e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacc47ba-aec7-410a-90ad-0ffb0e6e3e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77583c9-654c-401b-a18c-3c1ebb3d67c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:13 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Volume 8704ae16-7fce-41c5-a4fe-5a1463f251e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5', 'volume_size': 1} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1843547320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8704ae16-7fce-41c5-a4fe-5a1463f251e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f85e14870e44be3b959e53308cf6e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:13Z,use_quota=True,user_id='f3a8f4091a9a4e6ea1ac0a887cb88e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Creating volume 8704ae16-7fce-41c5-a4fe-5a1463f251e5 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:53:13 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:13 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2" returned: 0 in 0.640s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:13 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 1073741824 Sep 09 17:53:13 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:13 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2 Sep 09 17:53:13 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:13 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-73aa3563-1af8-407e-a854-e04b7a711ec2" returned: 0 in 0.397s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-quobyte-73aa3563-1af8-407e-a854-e04b7a711ec2" released by "delete_volume" :: held 1.124s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Created reservations ['73263016-32bc-4075-9928-54307a0826a0', 'f82f221f-99d5-40ba-95d6-c1260e65225e', 'e6417074-0a05-4891-b072-f820a67e47b6', '9df976e3-6c47-48a0-a017-1c2f69939ce5'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:14 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:14 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:14 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 1073741824" returned: 0 in 0.894s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:14 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 Sep 09 17:53:14 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:14 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.478s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:14 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Deleted volume successfully. Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3640c895-8c77-4a99-9e79-04962bce9380 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-73aa3563-1af8-407e-a854-e04b7a711ec2-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:14 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5" returned: 0 in 0.377s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77583c9-654c-401b-a18c-3c1ebb3d67c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b656c6-eb98-4bcb-bacf-130552027d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Volume volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 (8704ae16-7fce-41c5-a4fe-5a1463f251e5): created successfully Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b656c6-eb98-4bcb-bacf-130552027d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Flow 'volume_create_manager' (f30aaee3-304c-43b4-90bd-f74eb554106f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:14 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-04673cf5-da42-44a0-9214-a1c18e6f165f tempest-AttachVolumeNegativeTest-1931294304 None] Created volume successfully. Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "cinder-0e1ab682-9422-414f-bfc8-df01c2fdf8c1-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-0e1ab682-9422-414f-bfc8-df01c2fdf8c1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "cinder-quobyte-0e1ab682-9422-414f-bfc8-df01c2fdf8c1" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-quobyte-0e1ab682-9422-414f-bfc8-df01c2fdf8c1" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27ae28-3808-47fe-b216-0e5811c7d9ec]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:15 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 Sep 09 17:53:15 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:15 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1" returned: 0 in 0.460s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:15 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1 Sep 09 17:53:15 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:15 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0e1ab682-9422-414f-bfc8-df01c2fdf8c1" returned: 0 in 0.305s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-quobyte-0e1ab682-9422-414f-bfc8-df01c2fdf8c1" released by "delete_volume" :: held 0.837s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Created reservations ['1baf693a-0249-416b-8b0b-86c68945e43c', 'a460ac8f-881a-461b-8119-b1910faa371a', 'aaeb4f70-974d-408a-8c39-1f452992909e', '101fb5bd-4101-4a35-98ca-134670ccfb21'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-0a2e4924-c5c2-430a-ad9d-fb086fc96e2c req-0137b282-737a-4d77-92ea-95e1a6476498 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-0a2e4924-c5c2-430a-ad9d-fb086fc96e2c req-0137b282-737a-4d77-92ea-95e1a6476498 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-0a2e4924-c5c2-430a-ad9d-fb086fc96e2c req-0137b282-737a-4d77-92ea-95e1a6476498 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-0a2e4924-c5c2-430a-ad9d-fb086fc96e2c req-0137b282-737a-4d77-92ea-95e1a6476498 tempest-AttachVolumeNegativeTest-1931294304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '874d4e93-e355-40f4-8838-3445f0234259', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:53:16 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:16 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-0a2e4924-c5c2-430a-ad9d-fb086fc96e2c req-0137b282-737a-4d77-92ea-95e1a6476498 tempest-AttachVolumeNegativeTest-1931294304 None] attachment_update completed successfully. Sep 09 17:53:16 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.426s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Deleted volume successfully. Sep 09 17:53:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b10d70b8-4347-4cd6-b623-742e212733a8 tempest-VolumesListAdminTestJSON-1561971987 None] Lock "cinder-0e1ab682-9422-414f-bfc8-df01c2fdf8c1-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-84417eb4-41c6-49df-b08f-f16b599cc025 req-b0f17763-9200-4505-acc3-7b69ed702f85 tempest-AttachVolumeNegativeTest-1931294304 None] Terminate volume connection completed successfully. Sep 09 17:53:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-84417eb4-41c6-49df-b08f-f16b599cc025 req-b0f17763-9200-4505-acc3-7b69ed702f85 tempest-AttachVolumeNegativeTest-1931294304 None] Deleting attachment 874d4e93-e355-40f4-8838-3445f0234259. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Flow 'volume_create_manager' (73d4a47b-66d5-4301-8f90-2256f0fadaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330cc3e4-36a7-42c7-bd2f-99bfc65743c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330cc3e4-36a7-42c7-bd2f-99bfc65743c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1188992988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0d1a69-169a-4980-93d2-f540163eccc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b69d9ce645b988277d5857145ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:24Z,use_quota=True,user_id='37660f2f0b0c43b4b3abe7c8983510b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba0a3d8-334c-42bb-8ce4-442e411a9480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba0a3d8-334c-42bb-8ce4-442e411a9480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d5dcb9-9b68-436e-84dc-6e1ca7883a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d5dcb9-9b68-436e-84dc-6e1ca7883a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0d1a69-169a-4980-93d2-f540163eccc4', 'volume_name': 'volume-8d0d1a69-169a-4980-93d2-f540163eccc4', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1157fa97-a036-4728-923d-6d0daa40ecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1157fa97-a036-4728-923d-6d0daa40ecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e39c02-a889-43be-879e-ea9bbc195dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:23 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Volume 8d0d1a69-169a-4980-93d2-f540163eccc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0d1a69-169a-4980-93d2-f540163eccc4', 'volume_size': 1} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1188992988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0d1a69-169a-4980-93d2-f540163eccc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b69d9ce645b988277d5857145ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:24Z,use_quota=True,user_id='37660f2f0b0c43b4b3abe7c8983510b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Creating volume 8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:53:23 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:53:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:23 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 1073741824 Sep 09 17:53:23 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:24 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 1073741824" returned: 0 in 0.557s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:24 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 Sep 09 17:53:24 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "cinder-8704ae16-7fce-41c5-a4fe-5a1463f251e5-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-8704ae16-7fce-41c5-a4fe-5a1463f251e5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "cinder-quobyte-8704ae16-7fce-41c5-a4fe-5a1463f251e5" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-quobyte-8704ae16-7fce-41c5-a4fe-5a1463f251e5" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d5dae3-26bf-4bbb-9176-2ae42d5b8af9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:24 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4" returned: 0 in 0.461s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:24 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 Sep 09 17:53:24 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e39c02-a889-43be-879e-ea9bbc195dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0d1a69-169a-4980-93d2-f540163eccc4', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0840fc8-360b-4fe6-a059-143a2cadfcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:24 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Volume volume-8d0d1a69-169a-4980-93d2-f540163eccc4 (8d0d1a69-169a-4980-93d2-f540163eccc4): created successfully Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0840fc8-360b-4fe6-a059-143a2cadfcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Flow 'volume_create_manager' (73d4a47b-66d5-4301-8f90-2256f0fadaa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:25 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4e3f2aaf-1ec7-4e4b-ac5f-03e61ce51100 tempest-VolumesDeleteCascade-2012789896 None] Created volume successfully. Sep 09 17:53:25 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5" returned: 0 in 0.460s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:25 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5 Sep 09 17:53:25 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:25 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8704ae16-7fce-41c5-a4fe-5a1463f251e5" returned: 0 in 0.284s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-quobyte-8704ae16-7fce-41c5-a4fe-5a1463f251e5" released by "delete_volume" :: held 0.831s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Created reservations ['571a41ea-ac48-44ac-9372-c6c83a57f64a', '265b7982-9a83-4ce8-9c1c-eff32f5d4a57', 'c0504f23-efa2-4036-ad7e-ed128e92383d', '4a2f2d8f-1502-44a5-8841-4f9b874ef3e7'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:25 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:25 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "cinder-77a1cd05-072c-48ef-ab98-dc720309186e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-77a1cd05-072c-48ef-ab98-dc720309186e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:26 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.470s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:26 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Deleted volume successfully. Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4b38d9af-5253-4227-88d6-7265dff71b39 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-8704ae16-7fce-41c5-a4fe-5a1463f251e5-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "cinder-quobyte-77a1cd05-072c-48ef-ab98-dc720309186e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-quobyte-77a1cd05-072c-48ef-ab98-dc720309186e" acquired by "delete_volume" :: waited 0.035s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[88659b1e-b6f7-4d8f-a056-1caa873af82d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Creating offline snapshot 0f5b9866-f0f8-44d5-bc51-af946b396351 of volume 8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c40977-ff6d-48b3-9809-8a3c25ac5d7f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:26 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e Sep 09 17:53:26 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:26 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 Sep 09 17:53:26 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:26 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e" returned: 0 in 0.498s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:26 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e Sep 09 17:53:26 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:27 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4" returned: 0 in 0.478s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:27 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 1G Sep 09 17:53:27 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:27 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-77a1cd05-072c-48ef-ab98-dc720309186e" returned: 0 in 0.325s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-quobyte-77a1cd05-072c-48ef-ab98-dc720309186e" released by "delete_volume" :: held 0.950s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Created reservations ['ccc1c98f-2526-4160-a6c8-7d98f620fbd2', 'a40a7590-49d5-4073-985e-81d03d64c74e', 'd97aabf4-4a50-459f-beca-ccee6ead4ac9', '5aae4a3a-573a-469c-9114-5ebe5d8faedd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:27 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:27 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:27 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 1G" returned: 0 in 0.705s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:27 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 Sep 09 17:53:27 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:27 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.277s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Deleted volume successfully. Sep 09 17:53:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2640d4c4-df51-4a25-b806-10313e426634 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-77a1cd05-072c-48ef-ab98-dc720309186e-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:28 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351" returned: 0 in 0.325s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:28 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 is being set with open permissions: ugo+rw Sep 09 17:53:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:28 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 Sep 09 17:53:28 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:28 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351" returned: 0 in 0.459s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:28 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.info Sep 09 17:53:28 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:28 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.info" returned: 0 in 0.412s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:29 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.info is being set with open permissions: ugo+rw Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:29 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.info Sep 09 17:53:29 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "cinder-052a8693-72f4-435c-bf13-64b899afc5f4-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-052a8693-72f4-435c-bf13-64b899afc5f4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "cinder-quobyte-052a8693-72f4-435c-bf13-64b899afc5f4" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-quobyte-052a8693-72f4-435c-bf13-64b899afc5f4" acquired by "delete_volume" :: waited 0.035s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a16b6f-6601-4fcd-843c-a11e6698f1e7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:29 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 Sep 09 17:53:29 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:29 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.info" returned: 0 in 0.520s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.122s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:29 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-dbc7d892-f347-401e-b3ee-9ffb4236f3f6 tempest-VolumesDeleteCascade-2012789896 None] Create snapshot completed successfully Sep 09 17:53:29 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4" returned: 0 in 0.649s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:29 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4 Sep 09 17:53:29 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:30 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-052a8693-72f4-435c-bf13-64b899afc5f4" returned: 0 in 0.385s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-quobyte-052a8693-72f4-435c-bf13-64b899afc5f4" released by "delete_volume" :: held 1.132s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Created reservations ['dd7d2d90-2da1-403d-8d78-1602ddaaccb7', '9deef2cd-8bd9-43d1-99e9-178faf5871fb', '5f2333da-15d1-47fc-95e7-e66df93aa7dc', '266c5783-0fb8-45f5-950e-c5b4a1d9b863'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:30 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:30 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-ced1c47b-1823-4a75-9132-cc915c569d3f req-f109810d-28c7-4bf1-bcae-54022de23578 tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-ced1c47b-1823-4a75-9132-cc915c569d3f req-f109810d-28c7-4bf1-bcae-54022de23578 tempest-TestStampPattern-418754457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-ced1c47b-1823-4a75-9132-cc915c569d3f req-f109810d-28c7-4bf1-bcae-54022de23578 tempest-TestStampPattern-418754457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-ced1c47b-1823-4a75-9132-cc915c569d3f req-f109810d-28c7-4bf1-bcae-54022de23578 tempest-TestStampPattern-418754457 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a00b25da-1ff2-442c-be68-47d7a0a95a77', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:53:30 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-ced1c47b-1823-4a75-9132-cc915c569d3f req-f109810d-28c7-4bf1-bcae-54022de23578 tempest-TestStampPattern-418754457 None] attachment_update completed successfully. Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Creating offline snapshot dea8bebe-ac1a-491a-ac10-02c9bd4882d0 of volume 8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:53:31 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.608s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:31 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Deleted volume successfully. Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c05f6b1-71a4-4d17-9562-24a50be09c1d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d1a1c45f-7772-4fb7-ad79-c850015aed76 tempest-AttachVolumeNegativeTest-1931294304 None] Lock "cinder-052a8693-72f4-435c-bf13-64b899afc5f4-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:31 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 Sep 09 17:53:31 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:31 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351" returned: 0 in 0.734s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0d1a69-169a-4980-93d2-f540163eccc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:53:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:32 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 1G Sep 09 17:53:32 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:32 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 1G" returned: 0 in 0.935s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:32 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 Sep 09 17:53:32 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:33 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0" returned: 0 in 0.469s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:33 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 is being set with open permissions: ugo+rw Sep 09 17:53:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:33 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 Sep 09 17:53:33 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:33 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0" returned: 0 in 0.328s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f3a6cdba-100d-463d-b747-f8ac38724071 tempest-VolumesDeleteCascade-2012789896 None] Create snapshot completed successfully Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-8d0d1a69-169a-4980-93d2-f540163eccc4-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-8d0d1a69-169a-4980-93d2-f540163eccc4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Performing cascade delete. {{(pid=87202) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-0f5b9866-f0f8-44d5-bc51-af946b396351-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-0f5b9866-f0f8-44d5-bc51-af946b396351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-0f5b9866-f0f8-44d5-bc51-af946b396351" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-0f5b9866-f0f8-44d5-bc51-af946b396351" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Deleting offline snapshot 0f5b9866-f0f8-44d5-bc51-af946b396351 of volume 8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] snapshot_file for this snap is: volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398d2e9-b379-44a1-b87a-ba276871cdf7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-84f6ed94-2f6d-4d10-8466-5be3c51bf53b req-b7884777-1857-4e80-8cea-849bdac2a8e8 tempest-TestStampPattern-418754457 None] Terminate volume connection completed successfully. Sep 09 17:53:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-84f6ed94-2f6d-4d10-8466-5be3c51bf53b req-b7884777-1857-4e80-8cea-849bdac2a8e8 tempest-TestStampPattern-418754457 None] Deleting attachment a00b25da-1ff2-442c-be68-47d7a0a95a77. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:53:34 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 Sep 09 17:53:34 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:35 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351" returned: 0 in 0.424s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0d1a69-169a-4980-93d2-f540163eccc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:53:35 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e123bf-b874-42c1-83d8-bcf8d7d8bb54]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:35 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 Sep 09 17:53:35 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:35 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4" returned: 0 in 0.638s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:35 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[584ba22c-f637-4a5f-ae65-c06b9307e0d1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:36 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 Sep 09 17:53:36 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:36 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0" returned: 0 in 0.445s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0d1a69-169a-4980-93d2-f540163eccc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:53:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[088ba431-b1af-4c5a-97b2-874e8b579e20]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:36 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 Sep 09 17:53:36 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:37 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351" returned: 0 in 0.670s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0d1a69-169a-4980-93d2-f540163eccc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:53:37 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[755a8539-5a54-4ba2-8282-6a569562d776]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:37 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 Sep 09 17:53:37 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:37 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4" returned: 0 in 0.604s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:37 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 Sep 09 17:53:37 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:38 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351" returned: 0 in 0.574s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:38 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351 Sep 09 17:53:38 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:38 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.0f5b9866-f0f8-44d5-bc51-af946b396351" returned: 0 in 0.335s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 -F qcow2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:38 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 -F qcow2 Sep 09 17:53:38 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:39 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0d1a69-169a-4980-93d2-f540163eccc4 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 -F qcow2" returned: 0 in 0.497s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-0f5b9866-f0f8-44d5-bc51-af946b396351" released by "_delete_snapshot" :: held 4.535s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" released by "delete_snapshot" :: held 4.585s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Created reservations ['3639558b-8134-4e31-95e9-2719b8b57357', 'c147d93a-7c57-45e4-a515-cad76d151756', 'd6764129-5f56-48ff-a70c-54e65ec47f2c', '348ac6a4-b052-4fd1-9ed9-8c790e19a031'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:39 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Delete snapshot completed successfully. Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-0f5b9866-f0f8-44d5-bc51-af946b396351-delete_snapshot" released by "delete_snapshot" :: held 4.906s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-dea8bebe-ac1a-491a-ac10-02c9bd4882d0-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-dea8bebe-ac1a-491a-ac10-02c9bd4882d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-dea8bebe-ac1a-491a-ac10-02c9bd4882d0" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-dea8bebe-ac1a-491a-ac10-02c9bd4882d0" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Deleting offline snapshot dea8bebe-ac1a-491a-ac10-02c9bd4882d0 of volume 8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] snapshot_file for this snap is: volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc8c9f1-c533-4b48-af46-d71aa65e1eef]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:39 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 Sep 09 17:53:39 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-b089f20f-dcf7-4076-baa5-71c2577e7aeb-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:40 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Lock "cinder-b089f20f-dcf7-4076-baa5-71c2577e7aeb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0" returned: 0 in 0.552s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0d1a69-169a-4980-93d2-f540163eccc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54409a-97ad-4d7b-9bbb-b14e5ee2959d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-quobyte-b089f20f-dcf7-4076-baa5-71c2577e7aeb" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-b089f20f-dcf7-4076-baa5-71c2577e7aeb" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[56760a36-5812-4a1b-9b44-e53e40fd28e3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:40 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 Sep 09 17:53:40 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:40 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb Sep 09 17:53:40 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:40 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4" returned: 0 in 0.488s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:40 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 Sep 09 17:53:40 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:40 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb" returned: 0 in 0.521s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:40 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb Sep 09 17:53:40 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:41 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b089f20f-dcf7-4076-baa5-71c2577e7aeb" returned: 0 in 0.272s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-b089f20f-dcf7-4076-baa5-71c2577e7aeb" released by "delete_volume" :: held 0.843s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:41 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0" returned: 0 in 0.413s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:41 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0 Sep 09 17:53:41 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Created reservations ['e4be6676-733e-4b5c-90fa-1b1318916978', '1ad495ae-8d4a-4e1b-ae3d-1d1ab033111f', 'd06a6f49-7001-442f-9b89-a35a5747b59d', 'b8fbb02b-c967-444b-a73c-2fb7e9f044aa'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:41 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:41 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:41 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4.dea8bebe-ac1a-491a-ac10-02c9bd4882d0" returned: 0 in 0.379s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-dea8bebe-ac1a-491a-ac10-02c9bd4882d0" released by "_delete_snapshot" :: held 1.977s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" released by "delete_snapshot" :: held 2.025s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Created reservations ['8e735e86-bac3-4aad-8c31-f8f1560dcdfe', 'c0c1dd17-fbd4-4976-b5b2-5d1e409b703e', '02f8256c-e92f-41e5-bd1b-2a261e7ef84d', 'fad618f7-58b9-4451-a57c-10c5d527fd82'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:41 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.325s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Deleted volume successfully. Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5fbe7096-ef91-408e-99f2-bd48148de341 tempest-TestStampPattern-418754457 None] Lock "cinder-b089f20f-dcf7-4076-baa5-71c2577e7aeb-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Delete snapshot completed successfully. Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-dea8bebe-ac1a-491a-ac10-02c9bd4882d0-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Snapshots deleted, issuing volume delete {{(pid=87202) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9055f3-9b61-44e0-b8a0-b9148fbe1326]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:41 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 Sep 09 17:53:41 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:42 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4" returned: 0 in 0.395s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:42 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4 Sep 09 17:53:42 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:42 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d0d1a69-169a-4980-93d2-f540163eccc4" returned: 0 in 0.382s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8d0d1a69-169a-4980-93d2-f540163eccc4" released by "delete_volume" :: held 0.870s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Created reservations ['90ea420c-2948-4ca2-90ca-9723c5f71aec', 'ccb5ef23-f50f-42b5-8d8c-317ec088a0ce', '92479d3a-cff7-4891-b483-147679f3ab39', '0cf75b09-6c93-4ab4-b72f-4569c32aef47'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:42 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:42 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-54dabac6-f55b-441f-8f3d-3eeaac6ed315-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Lock "cinder-54dabac6-f55b-441f-8f3d-3eeaac6ed315-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-quobyte-767ee2b1-cb4a-429e-97c3-e94c644885fd" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-767ee2b1-cb4a-429e-97c3-e94c644885fd" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-quobyte-54dabac6-f55b-441f-8f3d-3eeaac6ed315" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-54dabac6-f55b-441f-8f3d-3eeaac6ed315" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Deleting offline snapshot 54dabac6-f55b-441f-8f3d-3eeaac6ed315 of volume 767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] snapshot_file for this snap is: volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b356d58-88ec-4d88-963f-787a0575e969]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:43 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.336s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:43 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Deleted volume successfully. Sep 09 17:53:43 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 Sep 09 17:53:43 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34038d59-ac92-46ed-a6fb-5ecd0b9e905f tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-8d0d1a69-169a-4980-93d2-f540163eccc4-delete_volume" released by "delete_volume" :: held 8.892s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:43 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315" returned: 0 in 0.433s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-767ee2b1-cb4a-429e-97c3-e94c644885fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d035d98b-1785-4a88-9cc0-701882d2deb6]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:43 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd Sep 09 17:53:43 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:44 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd" returned: 0 in 0.592s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:44 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 Sep 09 17:53:44 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=96,cinder:UPDATE=108,cinder:INSERT=27,cinder:DELETE=14 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Flow 'volume_create_manager' (7bb893a4-dfe5-4abe-a091-3da2b5d46039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2b5634-ddc3-454f-a3b2-f2de653d76f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-58aefff9-25de-4b6f-92f8-65aec00f02fa tempest-BackendsCapabilitiesAdminTestsJSON-2034939125 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3011779785156, 'free_capacity_gb': 1773.3011779785156, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87202) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d1fef5ec-de5d-4e7d-a246-c94b6b992ed4 tempest-BackendsCapabilitiesAdminTestsJSON-2034939125 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3011779785156, 'free_capacity_gb': 1773.3011779785156, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87202) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2b5634-ddc3-454f-a3b2-f2de653d76f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2022497586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d90ca7-4b14-4db6-83f0-2836d8b1b47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b69d9ce645b988277d5857145ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:44Z,use_quota=True,user_id='37660f2f0b0c43b4b3abe7c8983510b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ec2e17-00c2-4fdc-a67a-04e66cb2825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ec2e17-00c2-4fdc-a67a-04e66cb2825b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:44 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdcdbce-4852-4f19-8b4b-f8d1ad502760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdcdbce-4852-4f19-8b4b-f8d1ad502760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d90ca7-4b14-4db6-83f0-2836d8b1b47d', 'volume_name': 'volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c74bf8-b085-47c9-b0fe-8e664433c367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c74bf8-b085-47c9-b0fe-8e664433c367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d2b387-7e48-4a72-834c-991329a0c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:44 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Volume 96d90ca7-4b14-4db6-83f0-2836d8b1b47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d', 'volume_size': 1} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2022497586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d90ca7-4b14-4db6-83f0-2836d8b1b47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b69d9ce645b988277d5857145ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:44Z,use_quota=True,user_id='37660f2f0b0c43b4b3abe7c8983510b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Creating volume 96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:53:44 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315" returned: 0 in 0.441s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:44 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d 1073741824 Sep 09 17:53:44 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:44 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315 Sep 09 17:53:44 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:44 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd.54dabac6-f55b-441f-8f3d-3eeaac6ed315" returned: 0 in 0.268s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-54dabac6-f55b-441f-8f3d-3eeaac6ed315" released by "_delete_snapshot" :: held 1.884s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-767ee2b1-cb4a-429e-97c3-e94c644885fd" released by "delete_snapshot" :: held 1.924s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Created reservations ['e8dcc76f-baeb-4010-a8aa-c31feba4547f', '531b3409-af21-4fee-8a72-8a714af41b6a', '6999d143-4714-4976-b833-a43cad90db75', '555e5748-f83a-4cfb-b89e-353d83cd37d4'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:45 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d 1073741824" returned: 0 in 0.462s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Delete snapshot completed successfully. Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c7d64ee8-bba2-4906-b854-6e888c3a9dd1 tempest-TestStampPattern-418754457 None] Lock "cinder-54dabac6-f55b-441f-8f3d-3eeaac6ed315-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:45 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d Sep 09 17:53:45 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:45 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" returned: 0 in 0.273s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d2b387-7e48-4a72-834c-991329a0c884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042c7237-dc95-4039-813e-fb77c3042198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:45 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Volume volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d (96d90ca7-4b14-4db6-83f0-2836d8b1b47d): created successfully Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042c7237-dc95-4039-813e-fb77c3042198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Flow 'volume_create_manager' (7bb893a4-dfe5-4abe-a091-3da2b5d46039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a4d1e113-2622-4fba-b09d-f854e9ea420a tempest-VolumesDeleteCascade-2012789896 None] Created volume successfully. Sep 09 17:53:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Creating offline snapshot 8ea3d16f-a699-419e-a285-1385f9826829 of volume 96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:53:47 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d85fbdc-5d76-450c-8538-f075c19b5fd7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:47 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d Sep 09 17:53:47 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:47 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" returned: 0 in 0.402s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:47 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 1G Sep 09 17:53:47 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:48 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 1G" returned: 0 in 0.570s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:48 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 Sep 09 17:53:48 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:48 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829" returned: 0 in 0.428s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:48 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 is being set with open permissions: ugo+rw Sep 09 17:53:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:48 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 Sep 09 17:53:48 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:48 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:48 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.info Sep 09 17:53:48 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:49 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.info" returned: 0 in 0.275s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:49 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.info is being set with open permissions: ugo+rw Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:49 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.info Sep 09 17:53:49 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-767ee2b1-cb4a-429e-97c3-e94c644885fd-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:49 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.info" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Lock "cinder-767ee2b1-cb4a-429e-97c3-e94c644885fd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:49 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d9d963f3-f597-40ea-bf03-61794229e3d8 tempest-VolumesDeleteCascade-2012789896 None] Create snapshot completed successfully Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Acquiring lock "cinder-quobyte-767ee2b1-cb4a-429e-97c3-e94c644885fd" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-767ee2b1-cb4a-429e-97c3-e94c644885fd" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f83b61-69df-4265-a72f-717a5cf33f29]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:49 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd Sep 09 17:53:49 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:49 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd" returned: 0 in 0.364s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:49 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd Sep 09 17:53:49 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:50 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-767ee2b1-cb4a-429e-97c3-e94c644885fd" returned: 0 in 0.287s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Lock "cinder-quobyte-767ee2b1-cb4a-429e-97c3-e94c644885fd" released by "delete_volume" :: held 0.722s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Created reservations ['2e389a0b-f07b-4075-b4fb-4a61cee1846a', '5d1773ac-05f8-4671-8931-c17588efc9c7', '24380956-6369-45e1-9dc6-69ac3a30a511', 'b71dbefd-0c60-4a40-b3fa-222a9c97f810'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:50 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:53:50 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:50 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.353s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:53:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Deleted volume successfully. Sep 09 17:53:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7de256ed-3d29-440b-a13b-5d0a4d8ccff5 tempest-TestStampPattern-418754457 None] Lock "cinder-767ee2b1-cb4a-429e-97c3-e94c644885fd-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Flow 'volume_create_manager' (7685c985-6be9-4a85-a22c-aa582ee5a9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ea8fb1-1bc8-4e76-8375-73d5bc27c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ea8fb1-1bc8-4e76-8375-73d5bc27c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-333885840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc4a041-51ee-49d1-9704-8ae7d951837e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b69d9ce645b988277d5857145ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ea3d16f-a699-419e-a285-1385f9826829,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:51Z,use_quota=True,user_id='37660f2f0b0c43b4b3abe7c8983510b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcebedcd-5ef4-48e2-963c-b78b934618c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcebedcd-5ef4-48e2-963c-b78b934618c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e029e5a2-e0b8-4fed-9a95-b56cc3694271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e029e5a2-e0b8-4fed-9a95-b56cc3694271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7dc4a041-51ee-49d1-9704-8ae7d951837e', 'volume_name': 'volume-7dc4a041-51ee-49d1-9704-8ae7d951837e', 'volume_size': 1, 'snapshot_id': '8ea3d16f-a699-419e-a285-1385f9826829'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d03373-ccdc-4425-8e2d-a9d14de3f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d03373-ccdc-4425-8e2d-a9d14de3f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd5e89e-547f-47ba-b2fd-58c26d60b44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:51 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Volume 7dc4a041-51ee-49d1-9704-8ae7d951837e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7dc4a041-51ee-49d1-9704-8ae7d951837e', 'volume_size': 1, 'snapshot_id': '8ea3d16f-a699-419e-a285-1385f9826829'} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-8ea3d16f-a699-419e-a285-1385f9826829-7dc4a041-51ee-49d1-9704-8ae7d951837e" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8ea3d16f-a699-419e-a285-1385f9826829-7dc4a041-51ee-49d1-9704-8ae7d951837e" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Creating volume 7dc4a041-51ee-49d1-9704-8ae7d951837e from snapshot 8ea3d16f-a699-419e-a285-1385f9826829 {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-7dc4a041-51ee-49d1-9704-8ae7d951837e" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-7dc4a041-51ee-49d1-9704-8ae7d951837e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] snapshot: 8ea3d16f-a699-419e-a285-1385f9826829, volume: 7dc4a041-51ee-49d1-9704-8ae7d951837e, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[009a95cb-3a64-4a41-9aea-44835859eba3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:51 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 Sep 09 17:53:51 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:51 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829" returned: 0 in 0.453s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a59c9f8-2156-4abc-9e11-78b57727416c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:51 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d Sep 09 17:53:51 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-86c497ae-f26b-49ba-9be1-d113b606afe2 tempest-GroupSnapshotsTest-1985470142 None] Group tempest-GroupSnapshotsTest-Group-1403009996: creating Sep 09 17:53:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-86c497ae-f26b-49ba-9be1-d113b606afe2 tempest-GroupSnapshotsTest-1985470142 None] Group tempest-GroupSnapshotsTest-Group-1403009996: created successfully Sep 09 17:53:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-86c497ae-f26b-49ba-9be1-d113b606afe2 tempest-GroupSnapshotsTest-1985470142 None] Create group completed successfully. Sep 09 17:53:52 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" returned: 0 in 0.539s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:53:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:53:52 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:53:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:52 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e Sep 09 17:53:52 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Flow 'volume_create_manager' (cf4b75c2-d698-486f-acea-9d5b341abfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ad2a94-56aa-4824-b99c-401ed0556c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ad2a94-56aa-4824-b99c-401ed0556c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-958620695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59f23253-cf6e-47ca-91dd-676ddd087464,host='devstack@QuobyteHD#QuobyteHD',id=d6b0cf7d-7f5e-4064-9ef7-803ac8848bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0bee1006449f39ee763548a685de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:54Z,use_quota=True,user_id='c736f218e667485296efab618af1b3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc5b09f-cb57-43c8-b12d-d43d2b9342bc),volume_type_id=8fc5b09f-cb57-43c8-b12d-d43d2b9342bc)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e1c952-1f52-4b97-b8c5-bdf0d7e016c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e1c952-1f52-4b97-b8c5-bdf0d7e016c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96695c82-a944-4ab1-aa48-0b5f9996daef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96695c82-a944-4ab1-aa48-0b5f9996daef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b0cf7d-7f5e-4064-9ef7-803ac8848bac', 'volume_name': 'volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59e0a03-ec04-4d7e-8e76-a19ccb762f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59e0a03-ec04-4d7e-8e76-a19ccb762f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b3c2be-228b-4eab-80f6-987257053ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:54 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Volume d6b0cf7d-7f5e-4064-9ef7-803ac8848bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac', 'volume_size': 1} Sep 09 17:53:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Flow 'volume_create_manager' (d663f29e-f971-4c43-88de-2db8815752ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb19b30-7047-4535-a05b-cecdf4a3f53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb19b30-7047-4535-a05b-cecdf4a3f53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-249294967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31e2c29-35fe-43e5-8212-cce2b80866df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1399c659dc1b4f6eb4720696b67b23da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:56Z,use_quota=True,user_id='90c1eec2d1d1488fb461a7b922a61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef95f8ee-dcba-4f36-af39-8b7f5abbd06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef95f8ee-dcba-4f36-af39-8b7f5abbd06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e209727-95ed-40d6-8c66-b6ba95ed133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e209727-95ed-40d6-8c66-b6ba95ed133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31e2c29-35fe-43e5-8212-cce2b80866df', 'volume_name': 'volume-e31e2c29-35fe-43e5-8212-cce2b80866df', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b2084d-5c82-432c-9410-5d79d74c34a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b2084d-5c82-432c-9410-5d79d74c34a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14167a8d-6c4f-434b-a3a5-8b405ffb5e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Volume e31e2c29-35fe-43e5-8212-cce2b80866df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31e2c29-35fe-43e5-8212-cce2b80866df', 'volume_size': 1} Sep 09 17:53:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:57 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e" returned: 0 in 5.407s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:57 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:53:57 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Converted 1024.00 MB image at 189.28 MB/s Sep 09 17:53:57 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e is being set with open permissions: ugo+rw Sep 09 17:53:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:57 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e Sep 09 17:53:57 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:58 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e" returned: 0 in 0.295s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-7dc4a041-51ee-49d1-9704-8ae7d951837e" released by "_copy_volume_from_snapshot" :: held 6.780s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8ea3d16f-a699-419e-a285-1385f9826829-7dc4a041-51ee-49d1-9704-8ae7d951837e" released by "_create_volume_from_snapshot" :: held 6.854s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.877s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.262s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59f23253-cf6e-47ca-91dd-676ddd087464,created_at=2026-09-09T15:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-958620695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59f23253-cf6e-47ca-91dd-676ddd087464,host='devstack@QuobyteHD#QuobyteHD',id=d6b0cf7d-7f5e-4064-9ef7-803ac8848bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0bee1006449f39ee763548a685de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:54Z,use_quota=True,user_id='c736f218e667485296efab618af1b3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc5b09f-cb57-43c8-b12d-d43d2b9342bc),volume_type_id=8fc5b09f-cb57-43c8-b12d-d43d2b9342bc)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Creating volume d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:53:58 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:58 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac 1073741824 Sep 09 17:53:58 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd5e89e-547f-47ba-b2fd-58c26d60b44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc4a041-51ee-49d1-9704-8ae7d951837e', 'volume_size': 1, 'snapshot_id': '8ea3d16f-a699-419e-a285-1385f9826829'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f802b0-c90e-42bc-b068-d62c5e69daa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:58 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Volume volume-7dc4a041-51ee-49d1-9704-8ae7d951837e (7dc4a041-51ee-49d1-9704-8ae7d951837e): created successfully Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f802b0-c90e-42bc-b068-d62c5e69daa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Flow 'volume_create_manager' (7685c985-6be9-4a85-a22c-aa582ee5a9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-11de0af1-d7f6-48c0-bf53-3bdf9c2456ff tempest-VolumesDeleteCascade-2012789896 None] Created volume successfully. Sep 09 17:53:58 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac 1073741824" returned: 0 in 0.514s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:58 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac Sep 09 17:53:58 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:58 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" returned: 0 in 0.253s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.041s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-249294967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31e2c29-35fe-43e5-8212-cce2b80866df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1399c659dc1b4f6eb4720696b67b23da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:53:56Z,use_quota=True,user_id='90c1eec2d1d1488fb461a7b922a61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Creating volume e31e2c29-35fe-43e5-8212-cce2b80866df {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:53:58 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:58 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df 1073741824 Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b3c2be-228b-4eab-80f6-987257053ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:58 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7457e88-277a-40af-9d18-cb3e56f3779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:58 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Volume volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac (d6b0cf7d-7f5e-4064-9ef7-803ac8848bac): created successfully Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7457e88-277a-40af-9d18-cb3e56f3779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Flow 'volume_create_manager' (cf4b75c2-d698-486f-acea-9d5b341abfd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2544ce07-3429-46ef-aa16-c0f7fc8f676e tempest-GroupSnapshotsTest-1985470142 None] Created volume successfully. Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-96d90ca7-4b14-4db6-83f0-2836d8b1b47d-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-96d90ca7-4b14-4db6-83f0-2836d8b1b47d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Performing cascade delete. {{(pid=87202) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-8ea3d16f-a699-419e-a285-1385f9826829-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-8ea3d16f-a699-419e-a285-1385f9826829-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-8ea3d16f-a699-419e-a285-1385f9826829" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8ea3d16f-a699-419e-a285-1385f9826829" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Deleting offline snapshot 8ea3d16f-a699-419e-a285-1385f9826829 of volume 96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] snapshot_file for this snap is: volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e0df9d-89a7-447d-ae81-c743137d906c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:59 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 Sep 09 17:53:59 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:59 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df 1073741824" returned: 0 in 0.529s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:59 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df Sep 09 17:53:59 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:53:59 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829" returned: 0 in 0.392s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7506fda5-6efb-4d17-80ad-c2469bde4e49]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:53:59 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df" returned: 0 in 0.276s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14167a8d-6c4f-434b-a3a5-8b405ffb5e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31e2c29-35fe-43e5-8212-cce2b80866df', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4932a42c-b494-4f5d-88b5-4414e10a1955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:53:59 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Volume volume-e31e2c29-35fe-43e5-8212-cce2b80866df (e31e2c29-35fe-43e5-8212-cce2b80866df): created successfully Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4932a42c-b494-4f5d-88b5-4414e10a1955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:53:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Flow 'volume_create_manager' (d663f29e-f971-4c43-88de-2db8815752ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:53:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9030c522-2717-45a0-bf7d-0cb40c6f4c6c tempest-AttachVolumeTestJSON-2024533298 None] Created volume successfully. Sep 09 17:53:59 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d Sep 09 17:53:59 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] GroupSnapshot cb877666-1cdd-47e2-841e-f754b7b1f03b: creating. Sep 09 17:54:00 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" returned: 0 in 0.631s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Group snapshot cb877666-1cdd-47e2-841e-f754b7b1f03b: creating. {{(pid=87202) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:00 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 Sep 09 17:54:00 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Creating offline snapshot b794d55e-9064-4339-b6a4-58ec33c78472 of volume d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf895021-b3c2-46fe-a079-8453e932deee]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:00 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac Sep 09 17:54:00 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:00 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829" returned: 0 in 0.426s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:00 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829 Sep 09 17:54:00 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:00 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" returned: 0 in 0.429s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:00 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 1G Sep 09 17:54:00 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:01 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d.8ea3d16f-a699-419e-a285-1385f9826829" returned: 0 in 0.369s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-8ea3d16f-a699-419e-a285-1385f9826829" released by "_delete_snapshot" :: held 1.919s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" released by "delete_snapshot" :: held 1.946s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Created reservations ['12bf1d94-f887-4434-b8d8-21863b30e340', 'e33e6690-385d-4978-aea7-3cb2721c1762', '5112abbf-c4eb-4cce-aa49-fc58841fa9a7', 'a3aa940e-d4af-43a6-a626-c5d7eee024fa'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Delete snapshot completed successfully. Sep 09 17:54:01 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-8ea3d16f-a699-419e-a285-1385f9826829-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Snapshots deleted, issuing volume delete {{(pid=87202) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 1G" returned: 0 in 0.585s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" acquired by "delete_volume" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:01 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 Sep 09 17:54:01 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8324435b-3bda-481a-96b7-2b3b12a1f5b3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:01 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d Sep 09 17:54:01 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-84fe38fb-82e5-4114-9e9b-59fbc3594416 req-b58effa0-8fab-412a-be59-878ea909fa6c tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:01 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472" returned: 0 in 0.324s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:01 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:01 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 Sep 09 17:54:01 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:01 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" returned: 0 in 0.391s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:01 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d Sep 09 17:54:01 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:02 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:02 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.info Sep 09 17:54:02 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" returned: 0 in 0.311s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:02 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-96d90ca7-4b14-4db6-83f0-2836d8b1b47d" released by "delete_volume" :: held 0.779s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Created reservations ['3f43908b-dcf8-4d1a-b6ac-83b6c50080c5', 'b03461f9-428c-4a57-862b-e59410fcef1a', 'e8bc0103-a3b9-4be9-a5db-429d156503d0', '93eaaf53-178c-4050-a483-c8bf7590dd2c'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:02 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.info" returned: 0 in 0.345s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:02 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:02 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:02 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:02 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.info Sep 09 17:54:02 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:02 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.314s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Deleted volume successfully. Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4fb3579-08af-4ab1-a9bb-cf33d858a6ad tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-96d90ca7-4b14-4db6-83f0-2836d8b1b47d-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-7dc4a041-51ee-49d1-9704-8ae7d951837e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:02 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.info" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-7dc4a041-51ee-49d1-9704-8ae7d951837e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-84fe38fb-82e5-4114-9e9b-59fbc3594416 req-b58effa0-8fab-412a-be59-878ea909fa6c tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.128s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-84fe38fb-82e5-4114-9e9b-59fbc3594416 req-b58effa0-8fab-412a-be59-878ea909fa6c tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "cinder-quobyte-7dc4a041-51ee-49d1-9704-8ae7d951837e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-7dc4a041-51ee-49d1-9704-8ae7d951837e" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-84fe38fb-82e5-4114-9e9b-59fbc3594416 req-b58effa0-8fab-412a-be59-878ea909fa6c tempest-AttachVolumeTestJSON-2024533298 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-e31e2c29-35fe-43e5-8212-cce2b80866df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'decd38cf-299c-4985-b2f9-a2b44ffd0888', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7009c6-4204-4537-a704-8f6685d20143]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a6cb5d53-c8da-4923-ab05-0d97b6ba342b tempest-GroupSnapshotsTest-1985470142 None] group_snapshot cb877666-1cdd-47e2-841e-f754b7b1f03b: created successfully Sep 09 17:54:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-84fe38fb-82e5-4114-9e9b-59fbc3594416 req-b58effa0-8fab-412a-be59-878ea909fa6c tempest-AttachVolumeTestJSON-2024533298 None] attachment_update completed successfully. Sep 09 17:54:03 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e Sep 09 17:54:03 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:03 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e" returned: 0 in 0.420s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:03 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e Sep 09 17:54:03 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:03 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dc4a041-51ee-49d1-9704-8ae7d951837e" returned: 0 in 0.433s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-quobyte-7dc4a041-51ee-49d1-9704-8ae7d951837e" released by "delete_volume" :: held 0.917s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:03 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Created reservations ['1fd6e158-cc3e-446f-9709-f50606eb031b', '4b32ec22-fba6-4242-bed9-11ce6388d762', '468bada7-b84f-48a1-b469-59753e7f6205', '84ef33b1-b50e-4106-82a8-c184711234e5'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:04 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:04 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:04 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.277s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:04 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Deleted volume successfully. Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8d65fc5b-92b0-4530-ab8a-36f018432ed8 tempest-VolumesDeleteCascade-2012789896 None] Lock "cinder-7dc4a041-51ee-49d1-9704-8ae7d951837e-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-b794d55e-9064-4339-b6a4-58ec33c78472-8d13526d-5359-4157-a0cf-d8f61f026529" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-b794d55e-9064-4339-b6a4-58ec33c78472-8d13526d-5359-4157-a0cf-d8f61f026529" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Creating volume 8d13526d-5359-4157-a0cf-d8f61f026529 from snapshot b794d55e-9064-4339-b6a4-58ec33c78472 {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-8d13526d-5359-4157-a0cf-d8f61f026529" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-8d13526d-5359-4157-a0cf-d8f61f026529" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] snapshot: b794d55e-9064-4339-b6a4-58ec33c78472, volume: 8d13526d-5359-4157-a0cf-d8f61f026529, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d3504-d1e4-4cea-86d9-9a09ec75ef91]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:04 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 Sep 09 17:54:04 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:05 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:05 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:05 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472" returned: 0 in 0.482s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3af98d-8983-4786-aa3e-d9433e3dad1c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:05 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac Sep 09 17:54:05 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:05 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.479s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:54:05 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" returned: 0 in 0.681s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:54:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:05 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 Sep 09 17:54:05 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=134,cinder:UPDATE=146,cinder:INSERT=38,cinder:DELETE=7 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (163c0f25-1f41-46de-ba4d-a82289a2cb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18b369b-8323-4814-8194-150ffa0cac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18b369b-8323-4814-8194-150ffa0cac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493654643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:10Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5533bee0-f0e8-4686-a602-cd53bd126dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5533bee0-f0e8-4686-a602-cd53bd126dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f580ab4-4600-4aa8-afc1-447bb3e73225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f580ab4-4600-4aa8-afc1-447bb3e73225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a', 'volume_name': 'volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ce83cc-af67-43ca-bfc2-5a4aea2cca8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ce83cc-af67-43ca-bfc2-5a4aea2cca8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3426dc81-b0da-4562-8646-9c9747b9c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:10 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Volume 5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a', 'volume_size': 1} Sep 09 17:54:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (923dc98e-7d9e-4760-8d9c-c39e481f079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec14db7b-2436-4ac7-b999-1539e019344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec14db7b-2436-4ac7-b999-1539e019344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023496866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a0d71a-06ea-45a7-b408-0e3dd5cf0a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:11Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5ec8dd-055e-4d5b-8742-db0396645156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5ec8dd-055e-4d5b-8742-db0396645156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b5eb35-d46a-4d76-bfbd-6862c6016b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b5eb35-d46a-4d76-bfbd-6862c6016b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a0d71a-06ea-45a7-b408-0e3dd5cf0a87', 'volume_name': 'volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7832546-cae1-4d33-98dc-e387642edddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7832546-cae1-4d33-98dc-e387642edddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8206aca3-db05-453a-a53d-50181050f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:11 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Volume 23a0d71a-06ea-45a7-b408-0e3dd5cf0a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87', 'volume_size': 1} Sep 09 17:54:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:12 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529" returned: 0 in 6.349s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:54:12 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Converted 1024.00 MB image at 161.24 MB/s Sep 09 17:54:12 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:12 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 Sep 09 17:54:12 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529" returned: 0 in 0.490s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:12 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-8d13526d-5359-4157-a0cf-d8f61f026529" released by "_copy_volume_from_snapshot" :: held 8.130s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-b794d55e-9064-4339-b6a4-58ec33c78472-8d13526d-5359-4157-a0cf-d8f61f026529" released by "_create_volume_from_snapshot" :: held 8.362s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.381s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493654643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:10Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Creating volume 5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:12 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:12 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a 1073741824 Sep 09 17:54:12 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (035c26a2-2185-4b0e-9c29-db39127e6ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4952f1a-5761-48d6-93f2-f23e6bc97b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4952f1a-5761-48d6-93f2-f23e6bc97b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1610166032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee01c0dd-1009-4fdb-84a4-1e4635a7e56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:13Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9926824f-ca3d-4863-bd15-7668189fd9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9926824f-ca3d-4863-bd15-7668189fd9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742dfd15-1fa7-4e4b-96cd-1a53f24d5913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742dfd15-1fa7-4e4b-96cd-1a53f24d5913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee01c0dd-1009-4fdb-84a4-1e4635a7e56f', 'volume_name': 'volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56ca4ce-c536-4f79-a026-fb6e70ac293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56ca4ce-c536-4f79-a026-fb6e70ac293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260f2195-412c-4eac-b21c-6a2b7a98af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Volume ee01c0dd-1009-4fdb-84a4-1e4635a7e56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f', 'volume_size': 1} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b01f7f51-35e7-466f-b464-6b4c6b323c2d tempest-GroupSnapshotsTest-1985470142 None] Create group from source-snapshot-cb877666-1cdd-47e2-841e-f754b7b1f03b completed successfully. Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (42f12992-8942-4650-be79-cfa56948b333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156663e8-37b4-472e-91ef-5a183cb26bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156663e8-37b4-472e-91ef-5a183cb26bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1224639013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3808b54e-7deb-4247-8653-c1b7fafc1724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:13Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1c8ddd-aac8-4dfb-bb1c-606556545477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1c8ddd-aac8-4dfb-bb1c-606556545477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a05b670-a2c6-4a5a-a84f-6ba31734f85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a05b670-a2c6-4a5a-a84f-6ba31734f85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3808b54e-7deb-4247-8653-c1b7fafc1724', 'volume_name': 'volume-3808b54e-7deb-4247-8653-c1b7fafc1724', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d60a133-bc1b-471f-bc8a-d43b3f1f1163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d60a133-bc1b-471f-bc8a-d43b3f1f1163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dc8db9-0560-4169-95d2-157531aba62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:13 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Volume 3808b54e-7deb-4247-8653-c1b7fafc1724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3808b54e-7deb-4247-8653-c1b7fafc1724', 'volume_size': 1} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:13 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a 1073741824" returned: 0 in 0.671s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:13 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a Sep 09 17:54:13 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:14 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a" returned: 0 in 0.497s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023496866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a0d71a-06ea-45a7-b408-0e3dd5cf0a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:11Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Creating volume 23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:14 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:14 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 1073741824 Sep 09 17:54:14 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3426dc81-b0da-4562-8646-9c9747b9c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9a7441-a8fb-4227-8d47-98c13e33a621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Volume volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a (5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a): created successfully Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9a7441-a8fb-4227-8d47-98c13e33a621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (163c0f25-1f41-46de-ba4d-a82289a2cb6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:14 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8bc98b39-8929-46c6-84d6-27f4c0218c34 tempest-CreateVolumesFromImageTest-109933297 None] Created volume successfully. Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (45591109-9ed8-4c50-bac7-4199580fe646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2a274d-2066-4c54-938b-c66467adc2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2a274d-2066-4c54-938b-c66467adc2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1966668167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:14Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8010db-102c-435f-bdbe-36ed94f7f10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8010db-102c-435f-bdbe-36ed94f7f10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58d22e6-320e-49c4-9f55-5462968fbde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58d22e6-320e-49c4-9f55-5462968fbde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09', 'volume_name': 'volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48769a3-83bc-40ba-b855-5da4fa1132de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48769a3-83bc-40ba-b855-5da4fa1132de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ee2a77-6f12-4d4f-95b3-c585261ee858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Volume 3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09', 'volume_size': 1} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-8d13526d-5359-4157-a0cf-d8f61f026529" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-8d13526d-5359-4157-a0cf-d8f61f026529" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8adffc-b9df-4edf-8c44-945221cfea10]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:15 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 1073741824" returned: 0 in 0.905s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:15 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 Sep 09 17:54:15 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:15 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 Sep 09 17:54:15 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:15 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87" returned: 0 in 0.303s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.338s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1610166032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee01c0dd-1009-4fdb-84a4-1e4635a7e56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:13Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Creating volume ee01c0dd-1009-4fdb-84a4-1e4635a7e56f {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:15 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8206aca3-db05-453a-a53d-50181050f26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2ec8d6-4a4b-43bb-a2e6-15f1562c95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:15 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:15 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f 1073741824 Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529" returned: 0 in 0.637s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:15 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:15 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Volume volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 (23a0d71a-06ea-45a7-b408-0e3dd5cf0a87): created successfully Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2ec8d6-4a4b-43bb-a2e6-15f1562c95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:15 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529 Sep 09 17:54:15 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (923dc98e-7d9e-4760-8d9c-c39e481f079f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9f861591-c5ed-43fc-a7c7-01df17d9d800 tempest-CreateVolumesFromImageTest-109933297 None] Created volume successfully. Sep 09 17:54:16 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d13526d-5359-4157-a0cf-d8f61f026529" returned: 0 in 0.578s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-8d13526d-5359-4157-a0cf-d8f61f026529" released by "delete_volume" :: held 1.287s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['877206dc-3902-4ee3-9a7d-5b90cf433f22'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:16 devstack cinder-volume[87202]: WARNING cinder.quota [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1269072293 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1269072293, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:54:16 devstack cinder-volume[87202]: WARNING cinder.quota [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1269072293 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1269072293, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:54:16 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['867d8cae-6dca-4843-add0-8a9906257a22', '4c4fd836-56b7-4cbd-9db7-8abb407e7d64', 'd3ae928c-71bd-4228-b517-a0c07efb039d', '59e6d685-a569-4107-8361-73b11aac91db'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f 1073741824" returned: 0 in 0.867s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:16 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f Sep 09 17:54:16 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:16 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:16 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:16 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f" returned: 0 in 0.427s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.328s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1224639013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3808b54e-7deb-4247-8653-c1b7fafc1724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:13Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Creating volume 3808b54e-7deb-4247-8653-c1b7fafc1724 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:16 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:16 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 1073741824 Sep 09 17:54:16 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (260f2195-412c-4eac-b21c-6a2b7a98af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3785df-c9ea-45ad-a569-bd9ab4284008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:16 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Volume volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f (ee01c0dd-1009-4fdb-84a4-1e4635a7e56f): created successfully Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3785df-c9ea-45ad-a569-bd9ab4284008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (035c26a2-2185-4b0e-9c29-db39127e6ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-85a001ca-fc06-4097-855e-d3ab95f07ee8 tempest-CreateVolumesFromImageTest-109933297 None] Created volume successfully. Sep 09 17:54:17 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.496s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-dbc48b37-48d2-4958-a497-66c94ba42b8b tempest-GroupSnapshotsTest-1985470142 None] Delete group completed successfully. Sep 09 17:54:17 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 1073741824" returned: 0 in 0.579s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot cb877666-1cdd-47e2-841e-f754b7b1f03b: deleting Sep 09 17:54:17 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 Sep 09 17:54:17 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot cb877666-1cdd-47e2-841e-f754b7b1f03b: deleting {{(pid=87202) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-b794d55e-9064-4339-b6a4-58ec33c78472" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-b794d55e-9064-4339-b6a4-58ec33c78472" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Deleting offline snapshot b794d55e-9064-4339-b6a4-58ec33c78472 of volume d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] snapshot_file for this snap is: volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a716ef-5f60-4e46-9100-f0b0450440e0]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:17 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724" returned: 0 in 0.387s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.345s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1966668167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab410d462ce41409592cf6872f73c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:14Z,use_quota=True,user_id='c2dc6d78fc6f44928a060e19979c1053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Creating volume 3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:17 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:18 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 1073741824 Sep 09 17:54:18 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dc8db9-0560-4169-95d2-157531aba62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3808b54e-7deb-4247-8653-c1b7fafc1724', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfa8dff-513e-418f-bd0d-e1af909a0ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:18 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Volume volume-3808b54e-7deb-4247-8653-c1b7fafc1724 (3808b54e-7deb-4247-8653-c1b7fafc1724): created successfully Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfa8dff-513e-418f-bd0d-e1af909a0ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:18 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 Sep 09 17:54:18 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (42f12992-8942-4650-be79-cfa56948b333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:18 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8b93b0ce-27c5-4f1a-9998-d6e17785daff tempest-CreateVolumesFromImageTest-109933297 None] Created volume successfully. Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Flow 'volume_create_manager' (7195ce17-6ecf-42b4-ab5e-7941bc1724da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea99febf-4243-4783-abe4-682a93936ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea99febf-4243-4783-abe4-682a93936ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-547306113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41d7916-2eb4-4537-aa84-a7ea94e59e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd8d9af5f1444339ff15f62b137a695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:18Z,use_quota=True,user_id='94294ca2d3ea4cb7b8893118ada55d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8d947d-7002-4ee0-9cb2-bc844e846ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8d947d-7002-4ee0-9cb2-bc844e846ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a534d12-8de1-49c5-975b-c195ed34cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a534d12-8de1-49c5-975b-c195ed34cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41d7916-2eb4-4537-aa84-a7ea94e59e4a', 'volume_name': 'volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ebe063-70ef-4f1d-a905-1985278dae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ebe063-70ef-4f1d-a905-1985278dae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f32275-1a81-4355-a425-2f012e59a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:18 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Volume e41d7916-2eb4-4537-aa84-a7ea94e59e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a', 'volume_size': 1} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:18 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472" returned: 0 in 0.664s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0135bbb-b0a7-40f9-ba5a-4e650d502630]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:18 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 1073741824" returned: 0 in 0.678s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:18 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac Sep 09 17:54:18 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:18 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 Sep 09 17:54:18 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:18 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09" returned: 0 in 0.313s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-547306113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41d7916-2eb4-4537-aa84-a7ea94e59e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd8d9af5f1444339ff15f62b137a695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:18Z,use_quota=True,user_id='94294ca2d3ea4cb7b8893118ada55d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Creating volume e41d7916-2eb4-4537-aa84-a7ea94e59e4a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:19 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ee2a77-6f12-4d4f-95b3-c585261ee858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25346915-6e0a-43cf-b779-fa38a3b86c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:19 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a 1073741824 Sep 09 17:54:19 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:19 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Volume volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 (3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09): created successfully Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25346915-6e0a-43cf-b779-fa38a3b86c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Flow 'volume_create_manager' (45591109-9ed8-4c50-bac7-4199580fe646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-238dadfd-67f8-4f0f-b8d3-08faaebf6996 tempest-CreateVolumesFromImageTest-109933297 None] Created volume successfully. Sep 09 17:54:19 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" returned: 0 in 0.587s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:19 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 Sep 09 17:54:19 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-quobyte-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f2985d-be65-4149-9f4a-f12fa59c47ca]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:19 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a 1073741824" returned: 0 in 0.547s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:19 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472" returned: 0 in 0.454s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:19 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472 Sep 09 17:54:19 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:19 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a Sep 09 17:54:19 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:19 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 Sep 09 17:54:19 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:19 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a" returned: 0 in 0.268s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f32275-1a81-4355-a425-2f012e59a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329facac-01d6-438c-ba3d-fc7527a8725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:19 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Volume volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a (e41d7916-2eb4-4537-aa84-a7ea94e59e4a): created successfully Sep 09 17:54:19 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329facac-01d6-438c-ba3d-fc7527a8725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Flow 'volume_create_manager' (7195ce17-6ecf-42b4-ab5e-7941bc1724da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac.b794d55e-9064-4339-b6a4-58ec33c78472" returned: 0 in 0.336s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:19 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09" returned: 0 in 0.434s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-b794d55e-9064-4339-b6a4-58ec33c78472" released by "_delete_snapshot" :: held 2.186s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-76c50917-8359-4e1d-b5bf-7a7fcc7f7ab3 tempest-VolumesTransfersV357Test-590052842 None] Created volume successfully. Sep 09 17:54:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" released by "delete_snapshot" :: held 2.240s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:20 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09 Sep 09 17:54:20 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:20 devstack cinder-volume[87202]: WARNING cinder.quota [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1269072293 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1269072293, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['0111f221-4029-4428-a7f1-d91ac138b321', '611f6a7d-b0fb-4d40-a03a-110ff0e1fdc8', '4dd775c0-37ab-4560-9399-cfbb7ed0f82a', 'e1f999ae-5d15-4a98-9c94-7d367be66fcf'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:20 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3ba983c3-e234-44be-ab59-8ac03fc55931 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot cb877666-1cdd-47e2-841e-f754b7b1f03b: deleted successfully Sep 09 17:54:20 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09" returned: 0 in 0.287s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09" released by "delete_volume" :: held 0.763s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Created reservations ['9518cb9d-08cb-4c1c-a50f-3e0fed778d8c', '787e2f87-d081-473f-89b5-99e9a3873b28', '33ac863e-fc59-4ca2-8dca-9c29a46fba79', 'f41c97fe-b52e-4994-b58c-dd7651080184'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:20 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:20 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:20 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.291s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:20 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Deleted volume successfully. Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-3808b54e-7deb-4247-8653-c1b7fafc1724-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0c1dc8cc-a84b-46d8-812c-d4349db71d2c tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-3a4d14de-4c65-4bbf-ae38-ef28b6fbfe09-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-3808b54e-7deb-4247-8653-c1b7fafc1724-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-quobyte-3808b54e-7deb-4247-8653-c1b7fafc1724" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-3808b54e-7deb-4247-8653-c1b7fafc1724" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b110c7-607f-4448-906c-1c0fd06ca148]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" acquired by "delete_volume" :: waited 0.033s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:21 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 Sep 09 17:54:21 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[132dff24-a161-4b5a-94bf-ed718da81298]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:21 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac Sep 09 17:54:21 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:21 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724" returned: 0 in 0.536s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:21 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724 Sep 09 17:54:21 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:21 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" returned: 0 in 0.500s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:21 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac Sep 09 17:54:21 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:21 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a01a816e-2f60-4ed3-904b-b1b35daee8a5 tempest-VolumesTransfersV357Test-97182766 None] Transfer volume completed successfully. Sep 09 17:54:21 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3808b54e-7deb-4247-8653-c1b7fafc1724" returned: 0 in 0.417s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-3808b54e-7deb-4247-8653-c1b7fafc1724" released by "delete_volume" :: held 1.003s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Created reservations ['ff1f67a2-fdee-4c56-bcd6-6da538bbd884', 'fb92d64a-2ba4-49ac-ace8-8620b4fea01a', 'f4e241f9-264a-484c-ab28-d000037d992d', 'a85d31fc-6be3-4f51-83aa-7a868be2ad6f'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:21 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" returned: 0 in 0.364s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-d6b0cf7d-7f5e-4064-9ef7-803ac8848bac" released by "delete_volume" :: held 0.967s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['3cb88cdd-c581-49da-b20f-1dd1ffa34ec8'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:22 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:22 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:22 devstack cinder-volume[87202]: WARNING cinder.db.api [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1269072293'] Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['48238c12-5818-4c01-b153-aa9c7290a9ea', '46cee69f-013e-4321-97e3-ccf6f59bb506', '5ce3dcaf-f7fc-4138-8321-f07778ba2106', 'a99f5e51-399a-4551-a320-c17161cb5f83'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:22 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:22 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:22 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Deleted volume successfully. Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7aa05aba-4a9b-4e55-9f4b-edfd85cc5602 tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-3808b54e-7deb-4247-8653-c1b7fafc1724-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Acquiring lock "cinder-e41d7916-2eb4-4537-aa84-a7ea94e59e4a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Lock "cinder-e41d7916-2eb4-4537-aa84-a7ea94e59e4a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Acquiring lock "cinder-quobyte-e41d7916-2eb4-4537-aa84-a7ea94e59e4a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Lock "cinder-quobyte-e41d7916-2eb4-4537-aa84-a7ea94e59e4a" acquired by "delete_volume" :: waited 0.051s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba8db16-909b-4ecc-9286-2640ecb644ac]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:22 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.388s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:22 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ea9a9b3e-3311-4e80-b2e5-a83f44287f97 tempest-GroupSnapshotsTest-1985470142 None] Delete group completed successfully. Sep 09 17:54:22 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a Sep 09 17:54:22 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:23 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a" returned: 0 in 0.399s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:23 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a Sep 09 17:54:23 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-quobyte-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[57325edb-3995-4675-8c8f-3a7b790e332a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:23 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f Sep 09 17:54:23 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:23 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e41d7916-2eb4-4537-aa84-a7ea94e59e4a" returned: 0 in 0.289s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Lock "cinder-quobyte-e41d7916-2eb4-4537-aa84-a7ea94e59e4a" released by "delete_volume" :: held 0.752s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Created reservations ['f25d7d94-fbc3-4db3-8520-1949367e5b35', '9b0c54dc-1f18-4778-97bf-7155633a4733', '5b8839c1-647e-48e4-9587-da07a8bb9523', 'e0169fba-df72-4d22-a373-a3be0c5c1fd4'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:23 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:23 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:23 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f" returned: 0 in 0.564s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:23 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f Sep 09 17:54:23 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-46be2bda-f78c-49a3-898c-d200d7428724 tempest-GroupSnapshotsTest-1985470142 None] Group tempest-GroupSnapshotsTest-Group-224205809: creating Sep 09 17:54:24 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.377s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Deleted volume successfully. Sep 09 17:54:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-46be2bda-f78c-49a3-898c-d200d7428724 tempest-GroupSnapshotsTest-1985470142 None] Group tempest-GroupSnapshotsTest-Group-224205809: created successfully Sep 09 17:54:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-46be2bda-f78c-49a3-898c-d200d7428724 tempest-GroupSnapshotsTest-1985470142 None] Create group completed successfully. Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f851f46b-f9ab-4fca-9e5a-d8565fd3c3d9 tempest-VolumesTransfersV357Test-1357825850 None] Lock "cinder-e41d7916-2eb4-4537-aa84-a7ea94e59e4a-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:24 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f" returned: 0 in 0.388s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f" released by "delete_volume" :: held 1.003s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Created reservations ['0b7a6d17-3360-4e3c-ba12-774b755ebcfc', '0a0ac0e5-4de2-4e3a-9aa2-7f5e0c4c758f', '9abec84d-f65d-4c25-8b8c-9647b8a7c4e2', '47bbd2f0-2b02-4c58-b03e-fa1692e84b20'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:24 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:24 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Flow 'volume_create_manager' (03cfa0b1-a14e-4e28-b54f-0c3944bb227f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d19085b-e4a3-4abf-a116-0046cc905f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d19085b-e4a3-4abf-a116-0046cc905f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-737929504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc4c5ba-98fd-473c-913e-b75d6328a734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd8d9af5f1444339ff15f62b137a695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:25Z,use_quota=True,user_id='94294ca2d3ea4cb7b8893118ada55d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cafafe-4ae8-4753-ac55-b37f461fe214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35cafafe-4ae8-4753-ac55-b37f461fe214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ca65b8-0f4e-499e-b49a-f5ebb576c25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ca65b8-0f4e-499e-b49a-f5ebb576c25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc4c5ba-98fd-473c-913e-b75d6328a734', 'volume_name': 'volume-8fc4c5ba-98fd-473c-913e-b75d6328a734', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e404c273-8317-4e19-88df-1c77477c7c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e404c273-8317-4e19-88df-1c77477c7c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b9a066-faa5-4996-924e-8323271b1f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:24 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Volume 8fc4c5ba-98fd-473c-913e-b75d6328a734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc4c5ba-98fd-473c-913e-b75d6328a734', 'volume_size': 1} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-737929504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc4c5ba-98fd-473c-913e-b75d6328a734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fd8d9af5f1444339ff15f62b137a695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:25Z,use_quota=True,user_id='94294ca2d3ea4cb7b8893118ada55d9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Creating volume 8fc4c5ba-98fd-473c-913e-b75d6328a734 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:24 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:24 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:24 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 1073741824 Sep 09 17:54:24 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Deleted volume successfully. Sep 09 17:54:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-63883d93-4c70-4bb2-8e52-828c43dcccd0 tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-ee01c0dd-1009-4fdb-84a4-1e4635a7e56f-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:25 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 1073741824" returned: 0 in 0.438s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:25 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 Sep 09 17:54:25 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:25 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734" returned: 0 in 0.259s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b9a066-faa5-4996-924e-8323271b1f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc4c5ba-98fd-473c-913e-b75d6328a734', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23dc1d6-3b93-48e7-bbfb-374919d98293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:25 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Volume volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 (8fc4c5ba-98fd-473c-913e-b75d6328a734): created successfully Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23dc1d6-3b93-48e7-bbfb-374919d98293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Flow 'volume_create_manager' (03cfa0b1-a14e-4e28-b54f-0c3944bb227f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:25 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-41ca5cb5-e703-43fc-9e12-0374e87c2b57 tempest-VolumesTransfersV357Test-590052842 None] Created volume successfully. Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-quobyte-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[52006173-f345-4703-807c-3548f9bf96bc]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:25 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 Sep 09 17:54:25 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Flow 'volume_create_manager' (0771f56c-4fed-49bf-98d1-7bbfcb83c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c794090-0c76-41f8-af25-950993ef7d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c794090-0c76-41f8-af25-950993ef7d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870298076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35f18d53-fbe0-48b5-bed3-2c46fbbbb34f,host='devstack@QuobyteHD#QuobyteHD',id=a27066fd-0724-4b84-80f4-35a216cb43e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0bee1006449f39ee763548a685de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:26Z,use_quota=True,user_id='c736f218e667485296efab618af1b3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e452ba5-be2e-4d6d-aeeb-4621d41e513a),volume_type_id=9e452ba5-be2e-4d6d-aeeb-4621d41e513a)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36812ac3-b95a-4868-b919-285954d25c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36812ac3-b95a-4868-b919-285954d25c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bb9cbf-5878-41be-a24b-5302334220f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bb9cbf-5878-41be-a24b-5302334220f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27066fd-0724-4b84-80f4-35a216cb43e5', 'volume_name': 'volume-a27066fd-0724-4b84-80f4-35a216cb43e5', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbcbfe54-2344-4c23-8c04-705fce3e6012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbcbfe54-2344-4c23-8c04-705fce3e6012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2174ebf4-fe06-4562-9adc-96f4e865d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:25 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Volume a27066fd-0724-4b84-80f4-35a216cb43e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27066fd-0724-4b84-80f4-35a216cb43e5', 'volume_size': 1} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35f18d53-fbe0-48b5-bed3-2c46fbbbb34f,created_at=2026-09-09T15:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870298076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35f18d53-fbe0-48b5-bed3-2c46fbbbb34f,host='devstack@QuobyteHD#QuobyteHD',id=a27066fd-0724-4b84-80f4-35a216cb43e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0bee1006449f39ee763548a685de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:26Z,use_quota=True,user_id='c736f218e667485296efab618af1b3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e452ba5-be2e-4d6d-aeeb-4621d41e513a),volume_type_id=9e452ba5-be2e-4d6d-aeeb-4621d41e513a)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Creating volume a27066fd-0724-4b84-80f4-35a216cb43e5 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:26 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:26 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 1073741824 Sep 09 17:54:26 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Acquiring lock "cinder-8fc4c5ba-98fd-473c-913e-b75d6328a734-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Lock "cinder-8fc4c5ba-98fd-473c-913e-b75d6328a734-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:26 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87" returned: 0 in 0.535s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Acquiring lock "cinder-quobyte-8fc4c5ba-98fd-473c-913e-b75d6328a734" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:26 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87 Sep 09 17:54:26 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Lock "cinder-quobyte-8fc4c5ba-98fd-473c-913e-b75d6328a734" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872c4a3-c76c-44d1-ac06-0a4fceda5191]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:26 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 Sep 09 17:54:26 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:26 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87" returned: 0 in 0.300s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87" released by "delete_volume" :: held 0.909s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:26 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 1073741824" returned: 0 in 0.545s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:26 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 Sep 09 17:54:26 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Created reservations ['f3bbbb43-c0c7-421e-840d-0b3208cd50e0', '71c4dc92-5a24-45e0-95a8-fc49dbe59663', '6835fbc6-3f66-47b2-800f-23d63a42c21f', 'b49e489e-e800-4ebb-958d-fd1330ce0165'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:26 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:26 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:26 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734" returned: 0 in 0.640s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:26 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5" returned: 0 in 0.386s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:27 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734 Sep 09 17:54:27 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2174ebf4-fe06-4562-9adc-96f4e865d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27066fd-0724-4b84-80f4-35a216cb43e5', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a465d3-055c-4133-a37c-cdc3396090ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:27 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Volume volume-a27066fd-0724-4b84-80f4-35a216cb43e5 (a27066fd-0724-4b84-80f4-35a216cb43e5): created successfully Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a465d3-055c-4133-a37c-cdc3396090ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Flow 'volume_create_manager' (0771f56c-4fed-49bf-98d1-7bbfcb83c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:27 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.400s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0d18b602-32b3-42dc-85e4-6bb337c481ef tempest-GroupSnapshotsTest-1985470142 None] Created volume successfully. Sep 09 17:54:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Deleted volume successfully. Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "cinder-quobyte-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d2ba67f-3ae0-4ba6-86e8-8942c01d04db tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-23a0d71a-06ea-45a7-b408-0e3dd5cf0a87-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a" acquired by "delete_volume" :: waited 0.035s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dcea28-023a-4d74-a20f-8f7955458614]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:27 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8fc4c5ba-98fd-473c-913e-b75d6328a734" returned: 0 in 0.382s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Lock "cinder-quobyte-8fc4c5ba-98fd-473c-913e-b75d6328a734" released by "delete_volume" :: held 1.070s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:27 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a Sep 09 17:54:27 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Created reservations ['ed58161f-2ab6-47fa-8e9b-982f8e585afc', '1c48fa56-f4b9-488e-abbe-2699fe4a5e6d', '2d2ed732-b0ec-4293-850e-4d84bdfe5f2d', '7fcdace7-3ebe-4bbc-8e3e-727c33140416'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:27 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:27 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:27 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a" returned: 0 in 0.461s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:27 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a Sep 09 17:54:27 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:27 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.297s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Deleted volume successfully. Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d91ef730-f00d-42cf-b944-1bd77fd17360 tempest-VolumesTransfersV357Test-1357825850 None] Lock "cinder-8fc4c5ba-98fd-473c-913e-b75d6328a734-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:27 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a" returned: 0 in 0.267s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-quobyte-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a" released by "delete_volume" :: held 0.779s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Created reservations ['a93d0c56-9ae7-48bf-a534-99c4fb37c388', 'bd81b241-09c2-4eed-9af6-953a3ef78f89', '9edc5245-e85f-4e55-b9ef-030fc2881f8c', '98d3abbe-b2dc-4f4c-92b0-370cea394502'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:28 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:28 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:28 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.382s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:28 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Deleted volume successfully. Sep 09 17:54:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4cbcfd53-c23d-42ca-a32b-18d092b71d7a tempest-CreateVolumesFromImageTest-109933297 None] Lock "cinder-5c6f92fd-7498-428a-a1ac-2c7e1ec6cd7a-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Flow 'volume_create_manager' (248ab4c3-c1e5-43fc-a72e-09941fdbdbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725c518a-36d3-4800-af8b-d9a119195c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725c518a-36d3-4800-af8b-d9a119195c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1921366661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35f18d53-fbe0-48b5-bed3-2c46fbbbb34f,host='devstack@QuobyteHD#QuobyteHD',id=df2f1ec8-c3d4-4d02-bd4f-00a085973801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0bee1006449f39ee763548a685de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:29Z,use_quota=True,user_id='c736f218e667485296efab618af1b3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e452ba5-be2e-4d6d-aeeb-4621d41e513a),volume_type_id=9e452ba5-be2e-4d6d-aeeb-4621d41e513a)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8633ffb-7aee-4480-a05a-a1e5798fe762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8633ffb-7aee-4480-a05a-a1e5798fe762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a55aaa3-8cfc-4eb5-a05c-9f3fe9619cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a55aaa3-8cfc-4eb5-a05c-9f3fe9619cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2f1ec8-c3d4-4d02-bd4f-00a085973801', 'volume_name': 'volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae96cb8b-ba05-49b1-b6d6-088b3e47b11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae96cb8b-ba05-49b1-b6d6-088b3e47b11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977405df-92f2-425b-b405-99a808401d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:29 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Volume df2f1ec8-c3d4-4d02-bd4f-00a085973801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801', 'volume_size': 1} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35f18d53-fbe0-48b5-bed3-2c46fbbbb34f,created_at=2026-09-09T15:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1921366661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35f18d53-fbe0-48b5-bed3-2c46fbbbb34f,host='devstack@QuobyteHD#QuobyteHD',id=df2f1ec8-c3d4-4d02-bd4f-00a085973801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0bee1006449f39ee763548a685de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:29Z,use_quota=True,user_id='c736f218e667485296efab618af1b3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e452ba5-be2e-4d6d-aeeb-4621d41e513a),volume_type_id=9e452ba5-be2e-4d6d-aeeb-4621d41e513a)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Creating volume df2f1ec8-c3d4-4d02-bd4f-00a085973801 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:29 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:29 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 1073741824 Sep 09 17:54:29 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:29 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 1073741824" returned: 0 in 0.523s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:29 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 Sep 09 17:54:29 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:30 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801" returned: 0 in 0.282s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977405df-92f2-425b-b405-99a808401d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d25d312-bc6a-437f-aa69-8e05f4547e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:30 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Volume volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 (df2f1ec8-c3d4-4d02-bd4f-00a085973801): created successfully Sep 09 17:54:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d25d312-bc6a-437f-aa69-8e05f4547e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Flow 'volume_create_manager' (248ab4c3-c1e5-43fc-a72e-09941fdbdbe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:30 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8458f78e-3ee9-4fe3-accd-321e15808002 tempest-GroupSnapshotsTest-1985470142 None] Created volume successfully. Sep 09 17:54:30 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b7d882e5-4567-457b-9f8b-ac63fcd40a85 tempest-GroupSnapshotsTest-1985470142 None] Update group completed successfully. Sep 09 17:54:31 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-01090aa0-6789-4f11-b53f-76bae190efa7 tempest-GroupSnapshotsTest-1985470142 None] Update group completed successfully. Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (367c3aee-4bb8-4817-97fb-383ad440c319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef6096c-45c5-4501-bc1d-62ef2b874ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef6096c-45c5-4501-bc1d-62ef2b874ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424595109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12213a2e-afaf-4a6c-a7ea-de87ea5994fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:32Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b07e815-36c0-47e3-8b98-99d9f7065304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b07e815-36c0-47e3-8b98-99d9f7065304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a516ed-ecc8-48d2-a95c-25eda4ed0fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a516ed-ecc8-48d2-a95c-25eda4ed0fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12213a2e-afaf-4a6c-a7ea-de87ea5994fe', 'volume_name': 'volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a824e8-4488-45b6-bd78-906d7582b4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a824e8-4488-45b6-bd78-906d7582b4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbd9aad-7b5e-48db-8b8e-493385ea812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:32 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume 12213a2e-afaf-4a6c-a7ea-de87ea5994fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe', 'volume_size': 1} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424595109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12213a2e-afaf-4a6c-a7ea-de87ea5994fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:32Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Creating volume 12213a2e-afaf-4a6c-a7ea-de87ea5994fe {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:32 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:32 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe 1073741824 Sep 09 17:54:32 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:32 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe 1073741824" returned: 0 in 0.500s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:32 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe Sep 09 17:54:32 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:33 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" returned: 0 in 0.280s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbd9aad-7b5e-48db-8b8e-493385ea812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f52017f-9bbb-4268-abc7-68869168a135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe (12213a2e-afaf-4a6c-a7ea-de87ea5994fe): created successfully Sep 09 17:54:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f52017f-9bbb-4268-abc7-68869168a135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (367c3aee-4bb8-4817-97fb-383ad440c319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-de3d67da-1341-4b53-9bf0-331ef2a5c328 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created volume successfully. Sep 09 17:54:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e0741ae8-a7d8-41e1-a7c1-c0ee53cb7832 tempest-GroupSnapshotsTest-1985470142 None] Update group completed successfully. Sep 09 17:54:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a80998df-cb04-45cc-a96a-335a75ee0ec2 tempest-GroupSnapshotsTest-1985470142 None] Update group completed successfully. Sep 09 17:54:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Creating offline snapshot dc50b301-07d0-4350-aee6-55fea92e7d6f of volume 12213a2e-afaf-4a6c-a7ea-de87ea5994fe {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:54:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2453e9-8a15-481d-be0e-8a4f9c3355f5]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:34 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe Sep 09 17:54:34 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:34 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" returned: 0 in 0.376s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:34 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f 1G Sep 09 17:54:34 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:35 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f 1G" returned: 0 in 0.407s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:35 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f Sep 09 17:54:35 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:35 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f" returned: 0 in 0.374s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:35 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f is being set with open permissions: ugo+rw Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:35 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f Sep 09 17:54:35 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (2aae96b8-4fc2-4396-8e22-7caabef28983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb10ac8-025d-42b1-aeb2-a6320985c7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb10ac8-025d-42b1-aeb2-a6320985c7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1654303013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c39cea-f7c2-4210-a938-418eb3b9bb62,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:36Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cc9c8a-60fd-483f-bc08-1764746491a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cc9c8a-60fd-483f-bc08-1764746491a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3848ffed-865d-4a1f-976f-fae7dc96179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3848ffed-865d-4a1f-976f-fae7dc96179d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c39cea-f7c2-4210-a938-418eb3b9bb62', 'volume_name': 'volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6f6b47-1413-4a54-9f67-f0b1881b8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6f6b47-1413-4a54-9f67-f0b1881b8591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e60ecda-fd8b-48a8-abeb-f956ac5e1658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:35 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Volume a3c39cea-f7c2-4210-a938-418eb3b9bb62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62', 'volume_size': 1} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] GroupSnapshot 387b8cb9-86b2-4714-98cc-d38595258f42: creating. Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Group snapshot 387b8cb9-86b2-4714-98cc-d38595258f42: creating. {{(pid=87202) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 17:54:35 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f" returned: 0 in 0.263s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:35 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.info Sep 09 17:54:35 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:36 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.info" returned: 0 in 0.256s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:36 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.info is being set with open permissions: ugo+rw Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:36 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.info Sep 09 17:54:36 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:36 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.info" returned: 0 in 0.260s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1654303013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c39cea-f7c2-4210-a938-418eb3b9bb62,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:36Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Creating volume a3c39cea-f7c2-4210-a938-418eb3b9bb62 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:36 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:36 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b3be689e-eea2-4fd0-94d6-7fd7abce8da8 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Create snapshot completed successfully Sep 09 17:54:36 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 1073741824 Sep 09 17:54:36 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:37 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 1073741824" returned: 0 in 0.579s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:37 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 Sep 09 17:54:37 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (0740619f-9be5-4e36-83e7-fa702b016cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8205b68a-f580-48a1-861d-b7cbeebbee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8205b68a-f580-48a1-861d-b7cbeebbee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206233308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631f461c-324f-46f8-8de7-e143d1ff901c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:37Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04ed3ca-8f5b-41cd-87d1-cbdfd7334711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04ed3ca-8f5b-41cd-87d1-cbdfd7334711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0dd066-dc6f-4470-a499-fe5fc62c43fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0dd066-dc6f-4470-a499-fe5fc62c43fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631f461c-324f-46f8-8de7-e143d1ff901c', 'volume_name': 'volume-631f461c-324f-46f8-8de7-e143d1ff901c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4258f195-8db1-47cb-8220-16744f2efddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4258f195-8db1-47cb-8220-16744f2efddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc37080c-dde1-4501-8787-e4c3a96191e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume 631f461c-324f-46f8-8de7-e143d1ff901c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631f461c-324f-46f8-8de7-e143d1ff901c', 'volume_size': 1} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:37 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62" returned: 0 in 0.365s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.579s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e60ecda-fd8b-48a8-abeb-f956ac5e1658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ca16a1-aaaa-4e66-a83a-cd9a767e9812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Creating offline snapshot 0cd61ba7-ad54-4187-9755-2f13a0ad0583 of volume a27066fd-0724-4b84-80f4-35a216cb43e5 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:54:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Volume volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 (a3c39cea-f7c2-4210-a938-418eb3b9bb62): created successfully Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ca16a1-aaaa-4e66-a83a-cd9a767e9812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (2aae96b8-4fc2-4396-8e22-7caabef28983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b060f668-5b3c-44f3-b685-6d0a72cd91fa]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-fa3441ac-6f6e-497f-9199-ffac129a4637 tempest-VolumesGetTest-927547854 None] Created volume successfully. Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (c7504edb-a034-46a9-a2c4-7956e4b97f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6600361a-94ea-449b-b202-41eafadced8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6600361a-94ea-449b-b202-41eafadced8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087223562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59523124-7f11-4e82-9de1-fdb021554217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:38Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe68179-f1bd-484a-86e3-e34f86a1d4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe68179-f1bd-484a-86e3-e34f86a1d4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec59e61-ecd1-47b7-ae5d-4e9666505183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec59e61-ecd1-47b7-ae5d-4e9666505183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59523124-7f11-4e82-9de1-fdb021554217', 'volume_name': 'volume-59523124-7f11-4e82-9de1-fdb021554217', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f767c422-e2ef-49a8-a563-64be0c2e41e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f767c422-e2ef-49a8-a563-64be0c2e41e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:37 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 Sep 09 17:54:37 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566c67e3-6433-406c-9c77-917b7708bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume 59523124-7f11-4e82-9de1-fdb021554217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59523124-7f11-4e82-9de1-fdb021554217', 'volume_size': 1} Sep 09 17:54:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:38 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5" returned: 0 in 0.476s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:38 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 1G Sep 09 17:54:38 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (cc792d51-b13f-450b-8009-38c7137ed701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6782c85b-bc68-4958-8909-a105d12369c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6782c85b-bc68-4958-8909-a105d12369c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1616648590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800f8ad2-d229-41a3-a693-3b5ab6045346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:38Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa9e69c-f895-4b86-9605-f95c2d44c388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa9e69c-f895-4b86-9605-f95c2d44c388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d015caa-ed48-4865-b715-b796002ab846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d015caa-ed48-4865-b715-b796002ab846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800f8ad2-d229-41a3-a693-3b5ab6045346', 'volume_name': 'volume-800f8ad2-d229-41a3-a693-3b5ab6045346', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1961d2-fcee-4877-af2c-a0824959e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1961d2-fcee-4877-af2c-a0824959e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8251b-2f2d-4333-9416-3d8da572191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume 800f8ad2-d229-41a3-a693-3b5ab6045346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800f8ad2-d229-41a3-a693-3b5ab6045346', 'volume_size': 1} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:38 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (d1f53594-4a07-40df-93f2-fa6baab5ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116b0cef-ca5f-4fd5-b79e-877f2ceddc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 1G" returned: 0 in 0.506s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27066fd-0724-4b84-80f4-35a216cb43e5 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116b0cef-ca5f-4fd5-b79e-877f2ceddc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-806049951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c199fa-a33e-4741-be74-af76df20dad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:38Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:38 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27066fd-0724-4b84-80f4-35a216cb43e5 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f74a0-8a62-41e2-8d02-b79781a88ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f74a0-8a62-41e2-8d02-b79781a88ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6151718e-2aa3-46b6-a69b-2c8fd1b3bd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6151718e-2aa3-46b6-a69b-2c8fd1b3bd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c199fa-a33e-4741-be74-af76df20dad9', 'volume_name': 'volume-53c199fa-a33e-4741-be74-af76df20dad9', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2625e8c-dd1f-4399-83a8-4b2fdfffde62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2625e8c-dd1f-4399-83a8-4b2fdfffde62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11319c8d-a9f5-442b-a8da-2c2eece47022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:38 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume 53c199fa-a33e-4741-be74-af76df20dad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c199fa-a33e-4741-be74-af76df20dad9', 'volume_size': 1} Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:38 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27066fd-0724-4b84-80f4-35a216cb43e5 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583" returned: 0 in 0.368s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:38 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:54:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:38 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 Sep 09 17:54:38 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (aa064a30-c6bd-47d0-b275-89c6ab22704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:39 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd20b02-d455-4f60-9b5a-9a09f587bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (ca88627a-8216-40cf-99e4-e3bf8a85c68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0ad032-815d-42b2-b54e-6267c5e95cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583" returned: 0 in 0.317s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd20b02-d455-4f60-9b5a-9a09f587bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792421204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654b9998-3076-4a23-889f-4c0aa03cf9b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:39Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6a8867-ba45-4cf6-af57-02d094016b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6a8867-ba45-4cf6-af57-02d094016b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781d2940-beb8-4086-8bef-f580c647bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781d2940-beb8-4086-8bef-f580c647bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654b9998-3076-4a23-889f-4c0aa03cf9b6', 'volume_name': 'volume-654b9998-3076-4a23-889f-4c0aa03cf9b6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1683d1-c6b2-492e-8f5f-92acaac765fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1683d1-c6b2-492e-8f5f-92acaac765fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee8e95b-0017-4b5a-919e-d4bbfed28337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume 654b9998-3076-4a23-889f-4c0aa03cf9b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654b9998-3076-4a23-889f-4c0aa03cf9b6', 'volume_size': 1} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0ad032-815d-42b2-b54e-6267c5e95cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-885929463',display_name='tempest-VolumesGetTest-Volume-1541475938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7338a55-560c-4375-bb01-6c75e277520a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:39Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54034914-baf1-4a6f-9308-4d51a2ba3533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54034914-baf1-4a6f-9308-4d51a2ba3533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e40204-be69-4322-b8fb-890bd22a3906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e40204-be69-4322-b8fb-890bd22a3906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7338a55-560c-4375-bb01-6c75e277520a', 'volume_name': 'volume-d7338a55-560c-4375-bb01-6c75e277520a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be65f52-a365-451c-b2dd-73af2da0b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be65f52-a365-451c-b2dd-73af2da0b87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c383420-de4a-425e-a69f-281d0a9e4732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:39 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Volume d7338a55-560c-4375-bb01-6c75e277520a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7338a55-560c-4375-bb01-6c75e277520a', 'volume_size': 1} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:39 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.info Sep 09 17:54:39 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:39 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.info" returned: 0 in 0.260s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:39 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:39 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.info Sep 09 17:54:39 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:39 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-7228a251-456e-46c5-bdcd-f7f576a749b8 req-3b36b51b-f078-44e2-8564-61a9a14eb5d2 tempest-AttachVolumeTestJSON-2024533298 None] Terminate volume connection completed successfully. Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7228a251-456e-46c5-bdcd-f7f576a749b8 req-3b36b51b-f078-44e2-8564-61a9a14eb5d2 tempest-AttachVolumeTestJSON-2024533298 None] Deleting attachment decd38cf-299c-4985-b2f9-a2b44ffd0888. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:54:39 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.info" returned: 0 in 0.278s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Creating offline snapshot 6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 of volume df2f1ec8-c3d4-4d02-bd4f-00a085973801 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97536f4-9c82-4b49-adce-b40941af6edf]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:40 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 Sep 09 17:54:40 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:40 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801" returned: 0 in 0.352s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:40 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 1G Sep 09 17:54:40 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:40 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 1G" returned: 0 in 0.404s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:40 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 Sep 09 17:54:40 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:40 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0" returned: 0 in 0.329s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:40 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:54:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:41 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 Sep 09 17:54:41 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:41 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:41 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.info Sep 09 17:54:41 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:41 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.info" returned: 0 in 0.263s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:41 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:41 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.info Sep 09 17:54:41 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:41 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.info" returned: 0 in 0.231s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.156s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2087223562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59523124-7f11-4e82-9de1-fdb021554217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:38Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Creating volume 59523124-7f11-4e82-9de1-fdb021554217 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:41 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:41 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 1073741824 Sep 09 17:54:41 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8a58ab5c-c844-4406-8950-90d2157caf3d tempest-GroupSnapshotsTest-1985470142 None] group_snapshot 387b8cb9-86b2-4714-98cc-d38595258f42: created successfully Sep 09 17:54:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot 387b8cb9-86b2-4714-98cc-d38595258f42: deleting Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot 387b8cb9-86b2-4714-98cc-d38595258f42: deleting {{(pid=87202) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 17:54:42 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 1073741824" returned: 0 in 0.535s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-a27066fd-0724-4b84-80f4-35a216cb43e5" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-a27066fd-0724-4b84-80f4-35a216cb43e5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-0cd61ba7-ad54-4187-9755-2f13a0ad0583" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-0cd61ba7-ad54-4187-9755-2f13a0ad0583" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Deleting offline snapshot 0cd61ba7-ad54-4187-9755-2f13a0ad0583 of volume a27066fd-0724-4b84-80f4-35a216cb43e5 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:54:42 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 Sep 09 17:54:42 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] snapshot_file for this snap is: volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef49e4fd-50c9-497b-b90e-bd675efbb4eb]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:42 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 Sep 09 17:54:42 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:42 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217" returned: 0 in 0.321s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.597s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1616648590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800f8ad2-d229-41a3-a693-3b5ab6045346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:38Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Creating volume 800f8ad2-d229-41a3-a693-3b5ab6045346 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:42 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:42 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 1073741824 Sep 09 17:54:42 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566c67e3-6433-406c-9c77-917b7708bb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59523124-7f11-4e82-9de1-fdb021554217', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413abcf9-faca-4854-a251-9b3527ca38ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:42 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume volume-59523124-7f11-4e82-9de1-fdb021554217 (59523124-7f11-4e82-9de1-fdb021554217): created successfully Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413abcf9-faca-4854-a251-9b3527ca38ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (c7504edb-a034-46a9-a2c4-7956e4b97f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5341aa15-b855-43af-8961-ffba711a0a05 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created volume successfully. Sep 09 17:54:43 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583" returned: 0 in 0.481s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27066fd-0724-4b84-80f4-35a216cb43e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d047bd8-51eb-4729-94c1-d5ff4b823158]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:43 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 Sep 09 17:54:43 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:43 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 1073741824" returned: 0 in 0.536s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:43 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 Sep 09 17:54:43 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:43 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5" returned: 0 in 0.617s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:43 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 Sep 09 17:54:43 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:43 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346" returned: 0 in 0.448s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.291s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-806049951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c199fa-a33e-4741-be74-af76df20dad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:38Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Creating volume 53c199fa-a33e-4741-be74-af76df20dad9 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:43 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:43 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 1073741824 Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b8251b-2f2d-4333-9416-3d8da572191b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800f8ad2-d229-41a3-a693-3b5ab6045346', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:43 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36828b77-0326-4c6d-93cd-70f16cf15f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:44 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume volume-800f8ad2-d229-41a3-a693-3b5ab6045346 (800f8ad2-d229-41a3-a693-3b5ab6045346): created successfully Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36828b77-0326-4c6d-93cd-70f16cf15f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (cc792d51-b13f-450b-8009-38c7137ed701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:44 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b8986a59-159f-4026-85e3-f66160ecfd15 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created volume successfully. Sep 09 17:54:44 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583" returned: 0 in 0.639s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:44 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583 Sep 09 17:54:44 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:44 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 1073741824" returned: 0 in 0.759s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:44 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5.0cd61ba7-ad54-4187-9755-2f13a0ad0583" returned: 0 in 0.392s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-0cd61ba7-ad54-4187-9755-2f13a0ad0583" released by "_delete_snapshot" :: held 2.341s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-a27066fd-0724-4b84-80f4-35a216cb43e5" released by "delete_snapshot" :: held 2.388s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=176,cinder:INSERT=35,cinder:UPDATE=193,cinder:DELETE=14 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:54:44 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 Sep 09 17:54:44 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-df2f1ec8-c3d4-4d02-bd4f-00a085973801" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-df2f1ec8-c3d4-4d02-bd4f-00a085973801" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Deleting offline snapshot 6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 of volume df2f1ec8-c3d4-4d02-bd4f-00a085973801 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] snapshot_file for this snap is: volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dc8eb2-0cf6-4235-8e14-16879775dbac]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:45 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9" returned: 0 in 0.332s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.895s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792421204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654b9998-3076-4a23-889f-4c0aa03cf9b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:39Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Creating volume 654b9998-3076-4a23-889f-4c0aa03cf9b6 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:45 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11319c8d-a9f5-442b-a8da-2c2eece47022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c199fa-a33e-4741-be74-af76df20dad9', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cc67d7-6e96-48aa-9599-5e55dd0d50ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:45 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 1073741824 Sep 09 17:54:45 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:45 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume volume-53c199fa-a33e-4741-be74-af76df20dad9 (53c199fa-a33e-4741-be74-af76df20dad9): created successfully Sep 09 17:54:45 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 Sep 09 17:54:45 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cc67d7-6e96-48aa-9599-5e55dd0d50ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (d1f53594-4a07-40df-93f2-fa6baab5ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d38b0eef-9b61-4643-885c-2b1a620eca58 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created volume successfully. Sep 09 17:54:45 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0" returned: 0 in 0.792s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2914e50-f1d8-4968-baac-e172ef470292]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:46 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 Sep 09 17:54:46 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:46 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 1073741824" returned: 0 in 0.881s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:46 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 Sep 09 17:54:46 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:46 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801" returned: 0 in 0.473s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:46 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 Sep 09 17:54:46 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:46 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6" returned: 0 in 0.326s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.130s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-885929463',display_name='tempest-VolumesGetTest-Volume-1541475938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7338a55-560c-4375-bb01-6c75e277520a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:39Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Creating volume d7338a55-560c-4375-bb01-6c75e277520a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:46 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee8e95b-0017-4b5a-919e-d4bbfed28337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654b9998-3076-4a23-889f-4c0aa03cf9b6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:46 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a 1073741824 Sep 09 17:54:46 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f7344d-4309-4eb1-8cbd-06ce9607f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 (654b9998-3076-4a23-889f-4c0aa03cf9b6): created successfully Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f7344d-4309-4eb1-8cbd-06ce9607f32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (aa064a30-c6bd-47d0-b275-89c6ab22704e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4540c6eb-f3bb-4932-b771-9ca56703ea0a tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created volume successfully. Sep 09 17:54:46 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0" returned: 0 in 0.416s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:46 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0 Sep 09 17:54:46 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:46 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a 1073741824" returned: 0 in 0.523s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:47 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a Sep 09 17:54:47 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:47 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801.6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0" returned: 0 in 0.319s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-6bbb4f7d-3afe-4e90-87f8-bcbf394e16d0" released by "_delete_snapshot" :: held 2.158s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-df2f1ec8-c3d4-4d02-bd4f-00a085973801" released by "delete_snapshot" :: held 2.207s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:47 devstack cinder-volume[87202]: WARNING cinder.quota [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1126255815 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1126255815, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:54:47 devstack cinder-volume[87202]: WARNING cinder.quota [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1126255815 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1126255815, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['63ffc82b-8936-4328-8354-fd88983e95c1', 'f1bb72b0-b4f5-40d0-9d13-8dc808221f74', '65e3c0cc-d1cc-4948-a344-75b53d421b54', '6571e7d1-b705-48a9-8643-8684694e1dff'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:47 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a" returned: 0 in 0.276s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.855s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-206233308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631f461c-324f-46f8-8de7-e143d1ff901c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16e6b8a7d6b4e23bfa3c4fcd18962dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:37Z,use_quota=True,user_id='340a9f47ce064a36b8b3fc0ad41768d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Creating volume 631f461c-324f-46f8-8de7-e143d1ff901c {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:47 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c383420-de4a-425e-a69f-281d0a9e4732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7338a55-560c-4375-bb01-6c75e277520a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:47 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c 1073741824 Sep 09 17:54:47 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed582cf-d9d8-4aa0-a128-e1fdea6cd347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:47 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Volume volume-d7338a55-560c-4375-bb01-6c75e277520a (d7338a55-560c-4375-bb01-6c75e277520a): created successfully Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed582cf-d9d8-4aa0-a128-e1fdea6cd347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (ca88627a-8216-40cf-99e4-e3bf8a85c68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-eb5c60b3-6d5b-437b-9ff0-e97355ceffd9 tempest-VolumesGetTest-927547854 None] Created volume successfully. Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['9299e26f-acc0-4aac-8236-39b4928c9125', '377ee442-df57-484c-a712-9bc8c7b1fc69', '71d2c539-ac84-4b33-b61f-f9b344a2afc1', 'f09a0260-aec1-462d-b7fb-d47e55225515'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-16cbc26f-75e2-4520-9727-3d774a271e75 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot 387b8cb9-86b2-4714-98cc-d38595258f42: deleted successfully Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-d7338a55-560c-4375-bb01-6c75e277520a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Lock "cinder-d7338a55-560c-4375-bb01-6c75e277520a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-d7338a55-560c-4375-bb01-6c75e277520a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-d7338a55-560c-4375-bb01-6c75e277520a" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c37138e-5425-4434-adc8-204ea80fade9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:47 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c 1073741824" returned: 0 in 0.598s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:47 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c Sep 09 17:54:47 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:48 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a Sep 09 17:54:48 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:48 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c" returned: 0 in 0.318s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc37080c-dde1-4501-8787-e4c3a96191e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631f461c-324f-46f8-8de7-e143d1ff901c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0da901a-a820-4240-a81d-dcefbd36180a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:48 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Volume volume-631f461c-324f-46f8-8de7-e143d1ff901c (631f461c-324f-46f8-8de7-e143d1ff901c): created successfully Sep 09 17:54:48 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0da901a-a820-4240-a81d-dcefbd36180a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Flow 'volume_create_manager' (0740619f-9be5-4e36-83e7-fa702b016cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a" returned: 0 in 0.439s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:48 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-17834b41-b981-4532-bc44-7c9e6803e560 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created volume successfully. Sep 09 17:54:48 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a Sep 09 17:54:48 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:48 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d7338a55-560c-4375-bb01-6c75e277520a" returned: 0 in 0.293s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-d7338a55-560c-4375-bb01-6c75e277520a" released by "delete_volume" :: held 0.799s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-a27066fd-0724-4b84-80f4-35a216cb43e5" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-a27066fd-0724-4b84-80f4-35a216cb43e5" acquired by "delete_volume" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[07daa30e-eaf5-4bc3-8e0c-5e4b64cb9140]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Created reservations ['668b6a03-a0e8-4ffe-b4d8-ded793dabd04', '475e6d9f-de2e-48c3-90d2-910bf8df652a', 'd0dceacb-4ca1-4e73-9c6f-b287226f0757', 'a6d7744e-6027-4477-8357-26803035bc90'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-654b9998-3076-4a23-889f-4c0aa03cf9b6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-654b9998-3076-4a23-889f-4c0aa03cf9b6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:49 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 Sep 09 17:54:49 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:49 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-quobyte-654b9998-3076-4a23-889f-4c0aa03cf9b6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:49 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-654b9998-3076-4a23-889f-4c0aa03cf9b6" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46b46b5-3ae2-430b-bceb-466a532768b4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:49 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 Sep 09 17:54:49 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:49 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.300s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:49 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Deleted volume successfully. Sep 09 17:54:49 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5" returned: 0 in 0.513s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:49 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5 Sep 09 17:54:49 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8276c72a-d69d-485a-8aeb-6c4e7e94a2a2 tempest-VolumesGetTest-927547854 None] Lock "cinder-d7338a55-560c-4375-bb01-6c75e277520a-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:49 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6" returned: 0 in 0.410s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:49 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6 Sep 09 17:54:49 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:49 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a27066fd-0724-4b84-80f4-35a216cb43e5" returned: 0 in 0.275s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-a27066fd-0724-4b84-80f4-35a216cb43e5" released by "delete_volume" :: held 0.910s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-df2f1ec8-c3d4-4d02-bd4f-00a085973801" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-df2f1ec8-c3d4-4d02-bd4f-00a085973801" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef24a0-dbcf-4dcc-8b66-d1739f30c75a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:49 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-654b9998-3076-4a23-889f-4c0aa03cf9b6" returned: 0 in 0.263s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-654b9998-3076-4a23-889f-4c0aa03cf9b6" released by "delete_volume" :: held 0.722s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:49 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 Sep 09 17:54:49 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:49 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created reservations ['de14ea1e-6be6-441a-b20a-6220f3c64a14', '13578326-6680-4a42-ab52-c67c3f470bcd', 'fb42fa9b-a410-441a-a457-e79a2a6b0a9c', 'afa6ef38-6c2e-4de8-a2d8-0e0a0637619a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:50 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:50 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-a3c39cea-f7c2-4210-a938-418eb3b9bb62-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-53c199fa-a33e-4741-be74-af76df20dad9-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Lock "cinder-a3c39cea-f7c2-4210-a938-418eb3b9bb62-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-53c199fa-a33e-4741-be74-af76df20dad9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:50 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801" returned: 0 in 0.635s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-a3c39cea-f7c2-4210-a938-418eb3b9bb62" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:50 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801 Sep 09 17:54:50 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-quobyte-53c199fa-a33e-4741-be74-af76df20dad9" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:50 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-a3c39cea-f7c2-4210-a938-418eb3b9bb62" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-53c199fa-a33e-4741-be74-af76df20dad9" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c6796a-1173-453d-bd2d-f6767a1b034b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.438s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28720a0-75fd-41cd-8cf3-9bb127958471]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Deleted volume successfully. Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-87e4c1be-ca44-405c-b8e1-25f853fef1a1 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-654b9998-3076-4a23-889f-4c0aa03cf9b6-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:50 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 Sep 09 17:54:50 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:50 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 Sep 09 17:54:50 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:50 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-df2f1ec8-c3d4-4d02-bd4f-00a085973801" returned: 0 in 0.385s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-df2f1ec8-c3d4-4d02-bd4f-00a085973801" released by "delete_volume" :: held 1.082s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['e582757d-d67a-4342-ba48-4fa5f4b0c93a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:50 devstack cinder-volume[87202]: WARNING cinder.quota [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1126255815 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1126255815, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:54:50 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62" returned: 0 in 0.480s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:50 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['75e3fc86-6c09-44e1-a152-a79c611668b2', '40e74c00-02d5-419d-ac32-89f81c919d75', '93a52016-de3d-4bd7-b789-5e34ffcc017d', '5e2dc3e4-5357-42ec-a13f-cdef0ac8342a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:50 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62 Sep 09 17:54:50 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:51 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9" returned: 0 in 0.573s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:51 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9 Sep 09 17:54:51 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['54c76665-c9ac-4234-9e0c-6c3c135e4782', 'e122a115-cd00-4e26-8928-207da7775022', 'c92829f1-69a5-4fcf-b4d0-b72da7efe59a', '46371e5a-1e24-4e43-8950-8715dcf414c7'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:51 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a3c39cea-f7c2-4210-a938-418eb3b9bb62" returned: 0 in 0.387s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-a3c39cea-f7c2-4210-a938-418eb3b9bb62" released by "delete_volume" :: held 0.916s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:51 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:51 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:51 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-53c199fa-a33e-4741-be74-af76df20dad9" returned: 0 in 0.481s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-53c199fa-a33e-4741-be74-af76df20dad9" released by "delete_volume" :: held 1.104s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Created reservations ['2d15f0f3-ca6a-4d33-973a-de2d1c1bbced', '3e07df32-a1e3-4280-9724-72d15de8df4a', '6d7a3489-5073-4327-9796-de387928b9bc', 'c9736a88-8eee-498a-b20a-507646581a5c'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created reservations ['5519de8b-272d-4088-893d-87eb807f87a3', '0373ca89-ab83-4bdb-ae3a-977b799e46bd', '54a4be3c-c6ea-403c-a944-64f62cb82900', '90684a38-471e-4154-b5f4-22af8f28f6dd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:51 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:51 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:51 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.287s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f6e4b99c-ffc8-4f3f-b225-d76d4fc71cf1 tempest-GroupSnapshotsTest-1985470142 None] Delete group completed successfully. Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:51 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:51 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:52 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.280s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Deleted volume successfully. Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26c86c2a-3d4b-4e98-a4af-f815c77a1de5 tempest-VolumesGetTest-927547854 None] Lock "cinder-a3c39cea-f7c2-4210-a938-418eb3b9bb62-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:52 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.286s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Deleted volume successfully. Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d37f761-110b-4561-9b72-d0020af3eb84 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-53c199fa-a33e-4741-be74-af76df20dad9-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-800f8ad2-d229-41a3-a693-3b5ab6045346-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-800f8ad2-d229-41a3-a693-3b5ab6045346-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-quobyte-800f8ad2-d229-41a3-a693-3b5ab6045346" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-800f8ad2-d229-41a3-a693-3b5ab6045346" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b9754b-d8bb-4621-82da-06fa8fe734a7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:53 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 Sep 09 17:54:53 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (ef780be8-ef31-426c-8e14-254f8ee601f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:53 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e472bd93-1827-410e-958e-16bfcdcc1300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346" returned: 0 in 0.524s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e472bd93-1827-410e-958e-16bfcdcc1300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-826889629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b43931b-3c86-42c8-9bac-fc5e8f75afa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:53Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd354a0-4787-4212-b51b-eff4466e47db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd354a0-4787-4212-b51b-eff4466e47db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:53 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346 Sep 09 17:54:53 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323ab377-2237-4613-ae2b-9eb11c7f6ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323ab377-2237-4613-ae2b-9eb11c7f6ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b43931b-3c86-42c8-9bac-fc5e8f75afa6', 'volume_name': 'volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767da7ae-bbdb-4335-a69f-40d3d64c98c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767da7ae-bbdb-4335-a69f-40d3d64c98c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9855c108-2b12-4ddc-a705-e6ab9c8a6efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Volume 4b43931b-3c86-42c8-9bac-fc5e8f75afa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6', 'volume_size': 1} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-826889629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b43931b-3c86-42c8-9bac-fc5e8f75afa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:53Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Creating volume 4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:53 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2eb1a140-88ba-4287-bec1-8262ddf39a7b tempest-GroupSnapshotsTest-1985470142 None] Group tempest-GroupSnapshotsTest-Group-21054737: creating Sep 09 17:54:53 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 1073741824 Sep 09 17:54:53 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2eb1a140-88ba-4287-bec1-8262ddf39a7b tempest-GroupSnapshotsTest-1985470142 None] Group tempest-GroupSnapshotsTest-Group-21054737: created successfully Sep 09 17:54:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2eb1a140-88ba-4287-bec1-8262ddf39a7b tempest-GroupSnapshotsTest-1985470142 None] Create group completed successfully. Sep 09 17:54:53 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-800f8ad2-d229-41a3-a693-3b5ab6045346" returned: 0 in 0.299s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-800f8ad2-d229-41a3-a693-3b5ab6045346" released by "delete_volume" :: held 0.904s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created reservations ['2b5d74dd-bcd5-470d-9f28-0864a2981e8a', '34f41d95-80a9-4b70-959b-bc3a6b8327f7', '8f16d091-ccca-4f32-b61b-9eb04230d0d4', 'd52c826e-4990-4d14-a2f0-9ba1916cb320'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:53 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:53 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:53 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 1073741824" returned: 0 in 0.522s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-59523124-7f11-4e82-9de1-fdb021554217-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-59523124-7f11-4e82-9de1-fdb021554217-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-quobyte-59523124-7f11-4e82-9de1-fdb021554217" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:54 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-59523124-7f11-4e82-9de1-fdb021554217" acquired by "delete_volume" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:54 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4613f4-d6f9-4709-9016-f9a92ce486b6]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:54 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.377s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Deleted volume successfully. Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55cb4854-9b23-4bb5-b5a0-21866af8c031 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-800f8ad2-d229-41a3-a693-3b5ab6045346-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:54 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 Sep 09 17:54:54 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:54 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" returned: 0 in 0.407s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9855c108-2b12-4ddc-a705-e6ab9c8a6efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a20de-4a3c-4db5-bc7e-42234d1c1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:54 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Volume volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 (4b43931b-3c86-42c8-9bac-fc5e8f75afa6): created successfully Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a20de-4a3c-4db5-bc7e-42234d1c1010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (ef780be8-ef31-426c-8e14-254f8ee601f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ea6ff98d-02ed-4b07-bb3d-243d0dab728e tempest-VolumesGetTest-927547854 None] Created volume successfully. Sep 09 17:54:54 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217" returned: 0 in 0.433s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:54 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217 Sep 09 17:54:54 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:54 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-59523124-7f11-4e82-9de1-fdb021554217" returned: 0 in 0.322s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-59523124-7f11-4e82-9de1-fdb021554217" released by "delete_volume" :: held 0.813s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created reservations ['49be9ddc-5476-40e3-8a0a-ee89223016bc', 'cd0889d5-138f-4361-b39c-f573ebec94ca', '8a5ed7e8-22ea-4680-8531-39a0cd867c2d', '5ccafd28-1543-4e4a-8a3f-80ee7f66f35b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Flow 'volume_create_manager' (4b80370d-9761-40ff-99f9-70c8b12e7ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414009f6-fdf5-495a-9972-0990decc293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414009f6-fdf5-495a-9972-0990decc293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1185490903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3abfa94-032f-42a5-9ca0-0290e046830a,host='devstack@QuobyteHD#QuobyteHD',id=4910a40f-3ccb-4120-8d0a-2f2ba35ea51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0bee1006449f39ee763548a685de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:55Z,use_quota=True,user_id='c736f218e667485296efab618af1b3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a77b0d3-c8a8-4b5e-84dd-2fbd8894d273),volume_type_id=5a77b0d3-c8a8-4b5e-84dd-2fbd8894d273)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771a5b7c-8aba-4c13-b835-2e92040826f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771a5b7c-8aba-4c13-b835-2e92040826f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7489540-35ef-4fab-8769-06d93dcea0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7489540-35ef-4fab-8769-06d93dcea0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4910a40f-3ccb-4120-8d0a-2f2ba35ea51f', 'volume_name': 'volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979a3266-2acb-41c6-a76d-b6e1090262c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979a3266-2acb-41c6-a76d-b6e1090262c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184f8918-08b4-44fc-b852-a0efbbec35ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Volume 4910a40f-3ccb-4120-8d0a-2f2ba35ea51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f', 'volume_size': 1} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3abfa94-032f-42a5-9ca0-0290e046830a,created_at=2026-09-09T15:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1185490903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3abfa94-032f-42a5-9ca0-0290e046830a,host='devstack@QuobyteHD#QuobyteHD',id=4910a40f-3ccb-4120-8d0a-2f2ba35ea51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fed0bee1006449f39ee763548a685de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:55Z,use_quota=True,user_id='c736f218e667485296efab618af1b3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a77b0d3-c8a8-4b5e-84dd-2fbd8894d273),volume_type_id=5a77b0d3-c8a8-4b5e-84dd-2fbd8894d273)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Creating volume 4910a40f-3ccb-4120-8d0a-2f2ba35ea51f {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:54:55 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:55 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f 1073741824 Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:55 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-631f461c-324f-46f8-8de7-e143d1ff901c-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:55 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:55 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-631f461c-324f-46f8-8de7-e143d1ff901c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-quobyte-631f461c-324f-46f8-8de7-e143d1ff901c" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-631f461c-324f-46f8-8de7-e143d1ff901c" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd564ea0-3799-45ab-a790-8a47d9b063cb]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:55 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.446s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Deleted volume successfully. Sep 09 17:54:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a3dda228-2ea8-4642-9bad-30dc193f9715 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-59523124-7f11-4e82-9de1-fdb021554217-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:55 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c Sep 09 17:54:55 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:56 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f 1073741824" returned: 0 in 0.849s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:54:56 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f Sep 09 17:54:56 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (4b5369d3-97eb-4310-b988-83cfa145cfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0539ecb1-6778-41ae-af07-0418abf7f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:56 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0539ecb1-6778-41ae-af07-0418abf7f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-978905541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f995a3df-e138-4214-8028-83c0e69284d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4b43931b-3c86-42c8-9bac-fc5e8f75afa6,status='creating',terminated_at=None,updated_at=2026-09-09T15:54:56Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf11340-2041-4d85-a401-9084afce2f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf11340-2041-4d85-a401-9084afce2f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bada51e-984e-4df8-a101-b37ad69d89b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c" returned: 0 in 0.784s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bada51e-984e-4df8-a101-b37ad69d89b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f995a3df-e138-4214-8028-83c0e69284d2', 'volume_name': 'volume-f995a3df-e138-4214-8028-83c0e69284d2', 'volume_size': 1, 'source_volid': '4b43931b-3c86-42c8-9bac-fc5e8f75afa6', 'source_volstatus': 'available'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:56 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c Sep 09 17:54:56 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362c59b7-a462-46f5-9d3d-78f1b1ef2533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362c59b7-a462-46f5-9d3d-78f1b1ef2533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75348465-2c4a-4000-a260-9f16e6028718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Volume f995a3df-e138-4214-8028-83c0e69284d2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f995a3df-e138-4214-8028-83c0e69284d2', 'volume_size': 1, 'source_volid': '4b43931b-3c86-42c8-9bac-fc5e8f75afa6', 'source_volstatus': 'available'} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:56 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" returned: 0 in 0.328s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.073s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:56 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Cloning volume 4b43931b-3c86-42c8-9bac-fc5e8f75afa6 to volume f995a3df-e138-4214-8028-83c0e69284d2 Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184f8918-08b4-44fc-b852-a0efbbec35ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9bc0cb-15c0-4d1c-9956-d199a15d6a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:54:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Volume volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f (4910a40f-3ccb-4120-8d0a-2f2ba35ea51f): created successfully Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9bc0cb-15c0-4d1c-9956-d199a15d6a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Flow 'volume_create_manager' (4b80370d-9761-40ff-99f9-70c8b12e7ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Creating offline snapshot 725538e2-a383-4139-ad7d-575ab03e69a2 of volume 4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:54:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7ad476c1-f9f4-4927-a390-c701ea69e9a5 tempest-GroupSnapshotsTest-1985470142 None] Created volume successfully. Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[143138d6-0322-40d2-a809-65666861f101]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:56 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-631f461c-324f-46f8-8de7-e143d1ff901c" returned: 0 in 0.336s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-631f461c-324f-46f8-8de7-e143d1ff901c" released by "delete_volume" :: held 1.190s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:56 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 Sep 09 17:54:56 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created reservations ['25bbdb9a-44d9-426e-9846-5ae64e8f6bdd', 'ac3cb5f7-0f28-4b06-9651-f02e3342eb68', '4f26195b-c30c-4b98-9c71-7c036edabbab', '165f3f35-f1ed-4615-9a39-ad94e65fb407'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:56 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:54:56 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:56 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" returned: 0 in 0.420s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:57 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 1G Sep 09 17:54:57 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:57 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.300s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:54:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Deleted volume successfully. Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca80b76d-4277-4678-aed0-5076142684c7 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-631f461c-324f-46f8-8de7-e143d1ff901c-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:57 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 1G" returned: 0 in 0.412s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:57 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 Sep 09 17:54:57 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-dc50b301-07d0-4350-aee6-55fea92e7d6f-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-dc50b301-07d0-4350-aee6-55fea92e7d6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-quobyte-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-quobyte-dc50b301-07d0-4350-aee6-55fea92e7d6f" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-dc50b301-07d0-4350-aee6-55fea92e7d6f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Deleting offline snapshot dc50b301-07d0-4350-aee6-55fea92e7d6f of volume 12213a2e-afaf-4a6c-a7ea-de87ea5994fe {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] snapshot_file for this snap is: volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:54:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] GroupSnapshot 6f671acb-15a3-480c-b891-d31ed3ba8da0: creating. Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47ba854-38c1-4121-8b7b-387dce29ed1b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Group snapshot 6f671acb-15a3-480c-b891-d31ed3ba8da0: creating. {{(pid=87202) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 17:54:57 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2" returned: 0 in 0.443s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:57 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 is being set with open permissions: ugo+rw Sep 09 17:54:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:57 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 Sep 09 17:54:57 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:57 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f Sep 09 17:54:57 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:58 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2" returned: 0 in 0.316s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:58 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.info Sep 09 17:54:58 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:58 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f" returned: 0 in 0.465s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[16017a65-fe5d-479d-bbc3-3ecbfe61bae1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:58 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe Sep 09 17:54:58 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:58 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.info" returned: 0 in 0.296s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:58 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.info is being set with open permissions: ugo+rw Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:58 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.info Sep 09 17:54:58 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:58 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" returned: 0 in 0.397s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:58 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f Sep 09 17:54:58 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:58 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.info" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-f995a3df-e138-4214-8028-83c0e69284d2" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-f995a3df-e138-4214-8028-83c0e69284d2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] snapshot: 725538e2-a383-4139-ad7d-575ab03e69a2, volume: f995a3df-e138-4214-8028-83c0e69284d2, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0cbffe-ea71-41d7-930f-645dd561b24a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:58 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 Sep 09 17:54:58 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:59 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f" returned: 0 in 0.369s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:59 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f Sep 09 17:54:59 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:59 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2" returned: 0 in 0.380s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[301be55a-067c-43e1-8a4b-1067f21125d4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:59 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe.dc50b301-07d0-4350-aee6-55fea92e7d6f" returned: 0 in 0.281s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:59 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 Sep 09 17:54:59 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-dc50b301-07d0-4350-aee6-55fea92e7d6f" released by "_delete_snapshot" :: held 1.646s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" released by "delete_snapshot" :: held 1.679s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created reservations ['06df487a-6d28-40f4-ba3e-3e0ccfba5364', '423b02c9-55fd-4f4f-9f56-4de9af02fd3a', '4eef558c-c88c-42d9-85ff-6a7367b4129d', 'f9c69a55-203c-458a-949a-6c3b6b5cec21'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:54:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Delete snapshot completed successfully. Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edf052cb-f3fd-4a11-b916-11ad375a6ad4 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-dc50b301-07d0-4350-aee6-55fea92e7d6f-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:54:59 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" returned: 0 in 0.361s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:54:59 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 Sep 09 17:54:59 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-12213a2e-afaf-4a6c-a7ea-de87ea5994fe-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-12213a2e-afaf-4a6c-a7ea-de87ea5994fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "cinder-quobyte-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4584295b-3c4b-49aa-9dce-b80d3f613f71]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:54:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:00 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe Sep 09 17:55:00 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:00 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" returned: 0 in 0.570s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:00 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe Sep 09 17:55:00 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" returned: 0 in 0.539s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:01 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-quobyte-12213a2e-afaf-4a6c-a7ea-de87ea5994fe" released by "delete_volume" :: held 1.189s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Created reservations ['a521293a-90be-4418-8208-929ffe845025', 'fdf5121c-c57f-426e-be3c-b15415ad5436', 'f73443f9-d8b6-4ba4-b556-a122fe065914', '8ac8be21-874b-46ec-b0bd-5ed5792f577c'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:01 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:01 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:02 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.583s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:02 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Deleted volume successfully. Sep 09 17:55:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4570e32b-9f18-4a61-9ca7-1d10d7d0eb40 tempest-CreateVolumesFromSnapshotTest-1520755327 None] Lock "cinder-12213a2e-afaf-4a6c-a7ea-de87ea5994fe-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:04 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2" returned: 0 in 4.453s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6, size 1024.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:55:04 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Converted 1024.00 MB image at 229.87 MB/s Sep 09 17:55:04 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 is being set with open permissions: ugo+rw Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:04 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 Sep 09 17:55:04 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:04 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-f995a3df-e138-4214-8028-83c0e69284d2" released by "_copy_volume_from_snapshot" :: held 5.523s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-725538e2-a383-4139-ad7d-575ab03e69a2" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-725538e2-a383-4139-ad7d-575ab03e69a2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Deleting offline snapshot 725538e2-a383-4139-ad7d-575ab03e69a2 of volume 4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] snapshot_file for this snap is: volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f661de5-f7f3-48fe-8630-ae8edb6b5665]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:04 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 Sep 09 17:55:04 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:04 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2" returned: 0 in 0.387s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[71adfc79-a1b5-4d42-add8-4d76a7e25722]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:04 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 Sep 09 17:55:04 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:05 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:05 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:05 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.286s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:55:05 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" returned: 0 in 0.581s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:05 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 Sep 09 17:55:05 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:05 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2" returned: 0 in 0.386s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:05 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2 Sep 09 17:55:05 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:06 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6.725538e2-a383-4139-ad7d-575ab03e69a2" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-725538e2-a383-4139-ad7d-575ab03e69a2" released by "_delete_snapshot" :: held 1.709s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.650s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.276s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Creating offline snapshot fde6a98b-4f6a-449a-980e-cd1f1f80af74 of volume 4910a40f-3ccb-4120-8d0a-2f2ba35ea51f {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75348465-2c4a-4000-a260-9f16e6028718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f995a3df-e138-4214-8028-83c0e69284d2', 'volume_size': 1, 'source_volid': '4b43931b-3c86-42c8-9bac-fc5e8f75afa6', 'source_volstatus': 'available'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19163e4-14fc-42fa-8e74-9d897a6bb622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b9127-c83b-4ec9-973d-e7ce3228fba2]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:06 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Volume volume-f995a3df-e138-4214-8028-83c0e69284d2 (f995a3df-e138-4214-8028-83c0e69284d2): created successfully Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19163e4-14fc-42fa-8e74-9d897a6bb622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (4b5369d3-97eb-4310-b988-83cfa145cfcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:06 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2eb2a9cf-3f34-4ab8-8d30-b3ab98b042d9 tempest-VolumesGetTest-927547854 None] Created volume successfully. Sep 09 17:55:06 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f Sep 09 17:55:06 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Flow 'volume_create_manager' (f511f581-fad9-4f2d-84b9-fae057a0795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbfc357-3b80-475b-8c66-6bc57078d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbfc357-3b80-475b-8c66-6bc57078d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1803959395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cf7ab0-4653-46e3-8fb6-307257d1674a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a8014e00ac4c72845ed6a2d8bc8a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:06Z,use_quota=True,user_id='8bba935e3a434419b59b8ca7644bd5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ded285a-d38e-428d-aa27-f001ecbe372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ded285a-d38e-428d-aa27-f001ecbe372a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfd251c-a212-42fe-90ca-143fbbd4f8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfd251c-a212-42fe-90ca-143fbbd4f8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83cf7ab0-4653-46e3-8fb6-307257d1674a', 'volume_name': 'volume-83cf7ab0-4653-46e3-8fb6-307257d1674a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3c4ffe-ccdd-485f-8030-720cf3a90eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3c4ffe-ccdd-485f-8030-720cf3a90eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca5b89e-4a5f-46ce-8df8-d934d3ebd9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:06 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Volume 83cf7ab0-4653-46e3-8fb6-307257d1674a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83cf7ab0-4653-46e3-8fb6-307257d1674a', 'volume_size': 1} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:06 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" returned: 0 in 0.467s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:06 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 1G Sep 09 17:55:06 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:07 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 1G" returned: 0 in 0.430s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:07 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 Sep 09 17:55:07 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:07 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74" returned: 0 in 0.405s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:07 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:55:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:07 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 Sep 09 17:55:07 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:07 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74" returned: 0 in 0.506s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:08 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.info Sep 09 17:55:08 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (f692969f-d116-4b7c-99b6-6a0e3040da02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb68ada-cf83-4ff9-880d-273e5c4f4a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb68ada-cf83-4ff9-880d-273e5c4f4a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1853118625',display_name='tempest-VolumesGetTest-Volume-412580039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e42493-909b-489d-98cd-1a55561fa69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:08Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c8ba30-f1a8-4d96-ae6e-c165e4075df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c8ba30-f1a8-4d96-ae6e-c165e4075df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9a1cdd-616c-420d-96e2-5db04cea4e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9a1cdd-616c-420d-96e2-5db04cea4e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e42493-909b-489d-98cd-1a55561fa69c', 'volume_name': 'volume-25e42493-909b-489d-98cd-1a55561fa69c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1243921d-b020-4e39-b3ba-040c1252debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1243921d-b020-4e39-b3ba-040c1252debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:08 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fe6e16-2437-40cb-bef7-79e970096cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:08 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Volume 25e42493-909b-489d-98cd-1a55561fa69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e42493-909b-489d-98cd-1a55561fa69c', 'volume_size': 1} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.info" returned: 0 in 0.402s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:08 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:08 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.info Sep 09 17:55:08 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:08 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.info" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.220s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1803959395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cf7ab0-4653-46e3-8fb6-307257d1674a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a8014e00ac4c72845ed6a2d8bc8a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:06Z,use_quota=True,user_id='8bba935e3a434419b59b8ca7644bd5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Creating volume 83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:08 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:08 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a 1073741824 Sep 09 17:55:08 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:08 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b6023518-6540-4c59-abe8-e52948898d1d tempest-GroupSnapshotsTest-1985470142 None] group_snapshot 6f671acb-15a3-480c-b891-d31ed3ba8da0: created successfully Sep 09 17:55:09 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a 1073741824" returned: 0 in 0.500s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:09 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a Sep 09 17:55:09 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:09 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a" returned: 0 in 0.287s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.135s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1853118625',display_name='tempest-VolumesGetTest-Volume-412580039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e42493-909b-489d-98cd-1a55561fa69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:08Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Creating volume 25e42493-909b-489d-98cd-1a55561fa69c {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:09 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:09 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c 1073741824 Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca5b89e-4a5f-46ce-8df8-d934d3ebd9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83cf7ab0-4653-46e3-8fb6-307257d1674a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:09 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d6db76-e7f1-424b-9995-67194d97272c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:09 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Volume volume-83cf7ab0-4653-46e3-8fb6-307257d1674a (83cf7ab0-4653-46e3-8fb6-307257d1674a): created successfully Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d6db76-e7f1-424b-9995-67194d97272c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Flow 'volume_create_manager' (f511f581-fad9-4f2d-84b9-fae057a0795e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:09 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-80d95c6c-99cc-48ab-860a-0838b7345a05 tempest-VolumeDependencyTests-1205920761 None] Created volume successfully. Sep 09 17:55:09 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot 6f671acb-15a3-480c-b891-d31ed3ba8da0: deleting Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot 6f671acb-15a3-480c-b891-d31ed3ba8da0: deleting {{(pid=87202) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-fde6a98b-4f6a-449a-980e-cd1f1f80af74" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-fde6a98b-4f6a-449a-980e-cd1f1f80af74" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Deleting offline snapshot fde6a98b-4f6a-449a-980e-cd1f1f80af74 of volume 4910a40f-3ccb-4120-8d0a-2f2ba35ea51f {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] snapshot_file for this snap is: volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4cd494-455b-4acf-9384-2bd9663012a1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:09 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 Sep 09 17:55:09 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:10 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c 1073741824" returned: 0 in 0.528s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:10 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c Sep 09 17:55:10 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:10 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74" returned: 0 in 0.397s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[27783767-7ac7-4d84-9331-adced89e82f8]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:10 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f Sep 09 17:55:10 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:10 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c" returned: 0 in 0.292s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fe6e16-2437-40cb-bef7-79e970096cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e42493-909b-489d-98cd-1a55561fa69c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec37168-9a45-4f9f-8f89-914710289d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:10 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Volume volume-25e42493-909b-489d-98cd-1a55561fa69c (25e42493-909b-489d-98cd-1a55561fa69c): created successfully Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec37168-9a45-4f9f-8f89-914710289d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (f692969f-d116-4b7c-99b6-6a0e3040da02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:10 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ad4b3608-88bf-482d-a3b6-e5646ddd924f tempest-VolumesGetTest-927547854 None] Created volume successfully. Sep 09 17:55:10 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" returned: 0 in 0.390s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:10 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 Sep 09 17:55:10 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Creating offline snapshot cd249775-7576-4944-9135-a4000c1de75f of volume 83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[196e8e80-f792-4e34-a955-f98747fb3aa6]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:11 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a Sep 09 17:55:11 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:11 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74" returned: 0 in 0.429s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:11 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74 Sep 09 17:55:11 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:11 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a" returned: 0 in 0.411s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:11 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f 1G Sep 09 17:55:11 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:11 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f.fde6a98b-4f6a-449a-980e-cd1f1f80af74" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-fde6a98b-4f6a-449a-980e-cd1f1f80af74" released by "_delete_snapshot" :: held 1.646s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" released by "delete_snapshot" :: held 1.674s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=206,cinder:UPDATE=263,cinder:INSERT=68,cinder:DELETE=21 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:55:11 devstack cinder-volume[87202]: WARNING cinder.quota [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-328950302 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-328950302, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:55:11 devstack cinder-volume[87202]: WARNING cinder.quota [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-328950302 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-328950302, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['bc42494a-c1c4-4970-bd6e-13b13f17cbeb', 'a5a816f4-8904-44a6-a87b-de6e395e064b', '06125a2b-6f4d-49ea-ba47-eb7eeb1e6220', '3f8f7704-9f99-4323-9063-5fb16e5340ba'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-25e42493-909b-489d-98cd-1a55561fa69c-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Lock "cinder-25e42493-909b-489d-98cd-1a55561fa69c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7363c722-ad0b-4379-8292-534867569e17 tempest-GroupSnapshotsTest-1985470142 None] group_snapshot 6f671acb-15a3-480c-b891-d31ed3ba8da0: deleted successfully Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-25e42493-909b-489d-98cd-1a55561fa69c" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-25e42493-909b-489d-98cd-1a55561fa69c" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745ec42-44c7-40f0-ac91-b7bae9fceebc]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:11 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f 1G" returned: 0 in 0.571s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83cf7ab0-4653-46e3-8fb6-307257d1674a -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:11 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c Sep 09 17:55:11 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:11 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83cf7ab0-4653-46e3-8fb6-307257d1674a -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f Sep 09 17:55:11 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:12 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c" returned: 0 in 0.432s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:12 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c Sep 09 17:55:12 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:12 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83cf7ab0-4653-46e3-8fb6-307257d1674a -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f" returned: 0 in 0.405s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:12 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f is being set with open permissions: ugo+rw Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:12 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f Sep 09 17:55:12 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "cinder-quobyte-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb851d4-e7d0-4cce-80bc-a7fd5cda18ba]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:12 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-25e42493-909b-489d-98cd-1a55561fa69c" returned: 0 in 0.319s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-25e42493-909b-489d-98cd-1a55561fa69c" released by "delete_volume" :: held 0.799s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:12 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f" returned: 0 in 0.292s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:12 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.info Sep 09 17:55:12 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:12 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f Sep 09 17:55:12 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Created reservations ['410fc92d-190f-4848-bdef-13fd55cd9899', '84f7aacb-2709-4881-853f-36a1e9d2c968', '35a180e9-c822-492f-a4aa-51de85c92aa1', '7ef3b0f1-781e-442d-bd2d-5504ced89248'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:12 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:12 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-f995a3df-e138-4214-8028-83c0e69284d2-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Lock "cinder-f995a3df-e138-4214-8028-83c0e69284d2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:13 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" returned: 0 in 0.503s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:13 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f Sep 09 17:55:13 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-f995a3df-e138-4214-8028-83c0e69284d2" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-f995a3df-e138-4214-8028-83c0e69284d2" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:13 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.info" returned: 0 in 0.496s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:13 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.info is being set with open permissions: ugo+rw Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c6303b-bca2-4e26-982f-ce23bad4d117]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:13 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.info Sep 09 17:55:13 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:13 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.440s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Deleted volume successfully. Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ef059728-18e8-43c6-a6a6-f7882283b5b9 tempest-VolumesGetTest-927547854 None] Lock "cinder-25e42493-909b-489d-98cd-1a55561fa69c-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:13 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 Sep 09 17:55:13 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:13 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" returned: 0 in 0.311s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Lock "cinder-quobyte-4910a40f-3ccb-4120-8d0a-2f2ba35ea51f" released by "delete_volume" :: held 0.891s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['be8c9129-bdde-4bf1-ad17-a8c3d572de54'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:13 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.info" returned: 0 in 0.308s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:13 devstack cinder-volume[87202]: WARNING cinder.quota [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-328950302 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-328950302, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:55:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-fdeb9724-31e8-41c4-a386-673e2a0da4e7 tempest-VolumeDependencyTests-1205920761 None] Create snapshot completed successfully Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Created reservations ['30057db7-fe85-409d-8435-a68603e78773', 'd7893b3a-734c-438e-a0a5-1f8d1afbf883', '9611148c-3c17-419e-a020-0afb645bcaaa', 'c9f9597f-cb81-48ba-bd53-f8c51b512265'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:13 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2" returned: 0 in 0.496s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:13 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:13 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:13 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2 Sep 09 17:55:13 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:13 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:13 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-dc6b3081-995a-4468-a1ba-e091c09487ee tempest-GroupSnapshotsTest-1985470142 None] Delete group completed successfully. Sep 09 17:55:14 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f995a3df-e138-4214-8028-83c0e69284d2" returned: 0 in 0.320s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-f995a3df-e138-4214-8028-83c0e69284d2" released by "delete_volume" :: held 0.884s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Created reservations ['454f46f8-c7c5-4ab7-95ec-cd35388d626c', '88abbcc3-0ca1-4cc6-9af0-d4de0adf42e1', '815f0234-83b0-4c79-ab19-50b2ac040a78', '87d300fe-a347-46cd-af7c-78aba96a290e'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:14 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:14 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-4b43931b-3c86-42c8-9bac-fc5e8f75afa6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Lock "cinder-4b43931b-3c86-42c8-9bac-fc5e8f75afa6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9418d1ee-d4d9-4032-b814-8e84a8656219]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:14 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.388s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:14 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Deleted volume successfully. Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-265f473e-14a6-4311-a3a3-aa7d87cab392 tempest-VolumesGetTest-927547854 None] Lock "cinder-f995a3df-e138-4214-8028-83c0e69284d2-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:14 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 Sep 09 17:55:14 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:14 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Flow 'volume_create_manager' (aea7ad88-0611-4758-a2b2-7afb0b54d997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91eee50-3396-4a97-8318-ef8ec04868e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91eee50-3396-4a97-8318-ef8ec04868e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1894094536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94010022-c07b-4b33-94ea-2e4cfb8319ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a8014e00ac4c72845ed6a2d8bc8a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd249775-7576-4944-9135-a4000c1de75f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:15Z,use_quota=True,user_id='8bba935e3a434419b59b8ca7644bd5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4c1aa4-4acd-4bca-a542-52dc8b0c5728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4c1aa4-4acd-4bca-a542-52dc8b0c5728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fc83d1-5597-4b71-9dd3-fc66b1c3ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fc83d1-5597-4b71-9dd3-fc66b1c3ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94010022-c07b-4b33-94ea-2e4cfb8319ae', 'volume_name': 'volume-94010022-c07b-4b33-94ea-2e4cfb8319ae', 'volume_size': 1, 'snapshot_id': 'cd249775-7576-4944-9135-a4000c1de75f'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:15 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973b3e5d-0d48-4004-8520-6ba3dd521e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973b3e5d-0d48-4004-8520-6ba3dd521e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910c18dd-77df-4a64-8f25-772f12eae78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:15 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Volume 94010022-c07b-4b33-94ea-2e4cfb8319ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94010022-c07b-4b33-94ea-2e4cfb8319ae', 'volume_size': 1, 'snapshot_id': 'cd249775-7576-4944-9135-a4000c1de75f'} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" returned: 0 in 0.595s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-quobyte-cd249775-7576-4944-9135-a4000c1de75f-94010022-c07b-4b33-94ea-2e4cfb8319ae" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:15 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6 Sep 09 17:55:15 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-cd249775-7576-4944-9135-a4000c1de75f-94010022-c07b-4b33-94ea-2e4cfb8319ae" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Creating volume 94010022-c07b-4b33-94ea-2e4cfb8319ae from snapshot cd249775-7576-4944-9135-a4000c1de75f {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-quobyte-94010022-c07b-4b33-94ea-2e4cfb8319ae" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-94010022-c07b-4b33-94ea-2e4cfb8319ae" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] snapshot: cd249775-7576-4944-9135-a4000c1de75f, volume: 94010022-c07b-4b33-94ea-2e4cfb8319ae, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b09084-431b-40f6-be33-f1e83f9a1265]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:15 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f Sep 09 17:55:15 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:15 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" returned: 0 in 0.291s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-4b43931b-3c86-42c8-9bac-fc5e8f75afa6" released by "delete_volume" :: held 0.965s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Created reservations ['d55c7341-20f3-47d9-af4b-6221e0bb1c3b', '519daa7e-5dc5-4830-b66f-e30912f6a6db', '0b8abde9-500a-4c44-9836-b101f3e50220', '2c71afd9-9117-4a2b-a6bb-527467df4390'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:15 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:15 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:15 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f" returned: 0 in 0.493s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83cf7ab0-4653-46e3-8fb6-307257d1674a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74112ab-ca64-4fd2-8a1e-00a890253d1b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:15 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a Sep 09 17:55:15 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:15 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.393s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:16 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Deleted volume successfully. Sep 09 17:55:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-156b9a09-d335-4423-881b-7cc3a296e69e tempest-VolumesGetTest-927547854 None] Lock "cinder-4b43931b-3c86-42c8-9bac-fc5e8f75afa6-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:16 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a" returned: 0 in 0.502s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:55:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:55:16 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:55:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:16 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae Sep 09 17:55:16 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:18 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (be7cd767-c928-413d-b126-91a4a4f9a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cbda4de-d3d4-4b9f-8faf-342c40c14c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cbda4de-d3d4-4b9f-8faf-342c40c14c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1081235538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:19Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a995dad8-b944-4a6b-82df-f832908f4a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a995dad8-b944-4a6b-82df-f832908f4a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:18 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5e084e-a1e9-489a-93f8-6577b9197903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:18 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 17:55:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5e084e-a1e9-489a-93f8-6577b9197903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08', 'volume_name': 'volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4743e8fd-bb1c-4642-94f3-5e4d4972ee87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4743e8fd-bb1c-4642-94f3-5e4d4972ee87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:20 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c52127-408c-4012-93b1-4a0a400ecdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:20 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Volume 98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 17:55:20 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Trying to clone 98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 17:55:21 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 17:55:21 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Image download 20.69 MB at 20.69 MB/s Sep 09 17:55:21 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[36035508-5c91-4018-9db4-eb4841c5d979]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:21 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD Sep 09 17:55:21 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:22 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe is fetched for user 65970ab7e6e3415fb9b92be7143a182c. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa68a73-321f-44aa-9532-a95d922d238e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:22 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae" returned: 0 in 6.275s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:55:22 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Converted 1024.00 MB image at 163.15 MB/s Sep 09 17:55:22 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae is being set with open permissions: ugo+rw Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:22 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae Sep 09 17:55:22 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:22 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD Sep 09 17:55:22 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:22 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:22 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae" returned: 0 in 0.377s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-94010022-c07b-4b33-94ea-2e4cfb8319ae" released by "_copy_volume_from_snapshot" :: held 7.754s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-cd249775-7576-4944-9135-a4000c1de75f-94010022-c07b-4b33-94ea-2e4cfb8319ae" released by "_create_volume_from_snapshot" :: held 7.909s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.930s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1081235538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:19Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Creating volume 98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:23 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:23 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 1073741824 Sep 09 17:55:23 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910c18dd-77df-4a64-8f25-772f12eae78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94010022-c07b-4b33-94ea-2e4cfb8319ae', 'volume_size': 1, 'snapshot_id': 'cd249775-7576-4944-9135-a4000c1de75f'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bc84d7-1e89-4cf0-b1ae-f9f7ea93249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:23 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Volume volume-94010022-c07b-4b33-94ea-2e4cfb8319ae (94010022-c07b-4b33-94ea-2e4cfb8319ae): created successfully Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bc84d7-1e89-4cf0-b1ae-f9f7ea93249d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Flow 'volume_create_manager' (aea7ad88-0611-4758-a2b2-7afb0b54d997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:23 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0ea6b5c3-0240-4073-a228-149a0b43f0ee tempest-VolumeDependencyTests-1205920761 None] Created volume successfully. Sep 09 17:55:24 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 1073741824" returned: 0 in 0.954s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:24 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 Sep 09 17:55:24 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-cd249775-7576-4944-9135-a4000c1de75f-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-cd249775-7576-4944-9135-a4000c1de75f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-quobyte-83cf7ab0-4653-46e3-8fb6-307257d1674a" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-83cf7ab0-4653-46e3-8fb6-307257d1674a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-quobyte-cd249775-7576-4944-9135-a4000c1de75f" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-cd249775-7576-4944-9135-a4000c1de75f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Deleting offline snapshot cd249775-7576-4944-9135-a4000c1de75f of volume 83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] snapshot_file for this snap is: volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1b2691-3f82-4e56-84f0-825aa9983b01]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:24 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:24 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f Sep 09 17:55:24 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08" returned: 0 in 0.345s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Attempting download of d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55eca43-446e-42e1-bf4c-23f4b2f3bc86]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_jqbekec5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:24 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_jqbekec5 Sep 09 17:55:24 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:24 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f" returned: 0 in 0.668s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83cf7ab0-4653-46e3-8fb6-307257d1674a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61aa804-760c-4f63-a909-e9596de27ffa]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:25 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a Sep 09 17:55:25 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:25 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_jqbekec5" returned: 0 in 0.744s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_jqbekec5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:25 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_jqbekec5 Sep 09 17:55:25 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:25 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_jqbekec5" returned: 1 in 0.455s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_jqbekec5' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2dce77-9e50-4a6e-84cc-6eaf4265e950]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:25 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD Sep 09 17:55:25 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:25 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a" returned: 0 in 0.931s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:25 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f Sep 09 17:55:25 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:26 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe was qcow2, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:26 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 Sep 09 17:55:26 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:26 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f" returned: 0 in 0.483s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:26 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f Sep 09 17:55:26 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:26 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a.cd249775-7576-4944-9135-a4000c1de75f" returned: 0 in 0.371s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:26 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2d353d1b-34bd-448c-9a95-b0aa9c30be19 tempest-GroupSnapshotsV319Test-807137981 None] Group tempest-GroupSnapshotsV319Test-Group-728400411: creating Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-cd249775-7576-4944-9135-a4000c1de75f" released by "_delete_snapshot" :: held 2.644s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-83cf7ab0-4653-46e3-8fb6-307257d1674a" released by "delete_snapshot" :: held 2.677s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:26 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2d353d1b-34bd-448c-9a95-b0aa9c30be19 tempest-GroupSnapshotsV319Test-807137981 None] Group tempest-GroupSnapshotsV319Test-Group-728400411: created successfully Sep 09 17:55:26 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2d353d1b-34bd-448c-9a95-b0aa9c30be19 tempest-GroupSnapshotsV319Test-807137981 None] Create group completed successfully. Sep 09 17:55:26 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Created reservations ['a4071c09-f260-4488-a7b4-a9895b56305d', '24ca391c-5acb-4740-bff8-33ebc323b172', 'f22ffc3d-b89c-4e8c-9bed-deda8bc09f98', 'ace60120-48a4-4dce-9a74-429af42b51b7'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Delete snapshot completed successfully. Sep 09 17:55:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e505b69a-565d-4633-928c-b60ac3a6a2d0 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-cd249775-7576-4944-9135-a4000c1de75f-delete_snapshot" released by "delete_snapshot" :: held 2.862s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-83cf7ab0-4653-46e3-8fb6-307257d1674a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-83cf7ab0-4653-46e3-8fb6-307257d1674a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-quobyte-83cf7ab0-4653-46e3-8fb6-307257d1674a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-83cf7ab0-4653-46e3-8fb6-307257d1674a" acquired by "delete_volume" :: waited 0.054s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:27 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9e41e4-cc6f-49bb-b637-51fea6b0ee42]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:27 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a Sep 09 17:55:27 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:28 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a" returned: 0 in 0.600s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:28 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a Sep 09 17:55:28 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:28 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08" returned: 0 in 2.459s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_38nbguyqdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:55:28 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Converted 112.00 MB image at 45.52 MB/s Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:28 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-83cf7ab0-4653-46e3-8fb6-307257d1674a" returned: 0 in 0.535s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:28 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 1G Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-83cf7ab0-4653-46e3-8fb6-307257d1674a" released by "delete_volume" :: held 1.249s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:28 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Flow 'volume_create_manager' (1ac3f32c-7664-48c4-a70f-d3a163f5dff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1c44db-4a35-40bf-8b20-8ac591f68fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1c44db-4a35-40bf-8b20-8ac591f68fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1050073990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf9bc2bd-d55e-4646-8f9a-096ee54fca9a,host='devstack@QuobyteHD#QuobyteHD',id=40c5d1db-ecc3-4650-9164-59f550d92e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a52a158a6d4332944db540d2b41e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:29Z,use_quota=True,user_id='f95155133b9c426884cb9abb10b02e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f5a9bd9-b95d-4d86-acaa-7dfbf9ff73b9),volume_type_id=1f5a9bd9-b95d-4d86-acaa-7dfbf9ff73b9)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0a337d-05eb-4183-acd5-7511131eb341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0a337d-05eb-4183-acd5-7511131eb341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b064f646-f1b1-4d20-b5e4-96c67600313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b064f646-f1b1-4d20-b5e4-96c67600313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c5d1db-ecc3-4650-9164-59f550d92e9b', 'volume_name': 'volume-40c5d1db-ecc3-4650-9164-59f550d92e9b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b24fa99-e1cb-40f1-b089-1ef77617e246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b24fa99-e1cb-40f1-b089-1ef77617e246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65740d41-4ef7-4625-92bd-800304c7490d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:29 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Volume 40c5d1db-ecc3-4650-9164-59f550d92e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c5d1db-ecc3-4650-9164-59f550d92e9b', 'volume_size': 1} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf9bc2bd-d55e-4646-8f9a-096ee54fca9a,created_at=2026-09-09T15:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1050073990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf9bc2bd-d55e-4646-8f9a-096ee54fca9a,host='devstack@QuobyteHD#QuobyteHD',id=40c5d1db-ecc3-4650-9164-59f550d92e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a52a158a6d4332944db540d2b41e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:29Z,use_quota=True,user_id='f95155133b9c426884cb9abb10b02e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f5a9bd9-b95d-4d86-acaa-7dfbf9ff73b9),volume_type_id=1f5a9bd9-b95d-4d86-acaa-7dfbf9ff73b9)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Creating volume 40c5d1db-ecc3-4650-9164-59f550d92e9b {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:29 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:29 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b 1073741824 Sep 09 17:55:29 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Created reservations ['d81cb0dd-1fdf-468d-b0a3-7f13b8d839e3', '462e1d6f-cb6c-4ddf-b32f-f5c9f5a3cada', 'b1a5aa32-196f-4d98-bcfa-c602626746d7', '9e371679-1b89-4605-b5f2-fa234b75b354'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:29 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 1G" returned: 0 in 0.459s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Downloaded image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe for user 65970ab7e6e3415fb9b92be7143a182c is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Marking volume 98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Copying metadata from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe to 98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Creating volume glance metadata for volume 98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 backed by image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 17:55:29 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:29 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c52127-408c-4012-93b1-4a0a400ecdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597ddec9-5ec8-497b-92f8-44f70a12cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:29 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Volume volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 (98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08): created successfully Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597ddec9-5ec8-497b-92f8-44f70a12cd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (be7cd767-c928-413d-b126-91a4a4f9a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:29 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2afe49a0-8803-4bff-94cb-328fcf15297a tempest-VolumesGetTest-927547854 None] Created volume successfully. Sep 09 17:55:29 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.328s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:29 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Deleted volume successfully. Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3f3e801-4e37-41c8-a937-11c561de664d tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-83cf7ab0-4653-46e3-8fb6-307257d1674a-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:29 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b 1073741824" returned: 0 in 0.574s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:29 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b Sep 09 17:55:29 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-94010022-c07b-4b33-94ea-2e4cfb8319ae-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-94010022-c07b-4b33-94ea-2e4cfb8319ae-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "cinder-quobyte-94010022-c07b-4b33-94ea-2e4cfb8319ae" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-94010022-c07b-4b33-94ea-2e4cfb8319ae" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:30 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b" returned: 0 in 0.354s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[71deb2f2-0081-47b0-a040-6daaba46c581]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65740d41-4ef7-4625-92bd-800304c7490d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c5d1db-ecc3-4650-9164-59f550d92e9b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dab8d3f-2d13-46be-8aad-cce05da927bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:30 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Volume volume-40c5d1db-ecc3-4650-9164-59f550d92e9b (40c5d1db-ecc3-4650-9164-59f550d92e9b): created successfully Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dab8d3f-2d13-46be-8aad-cce05da927bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Flow 'volume_create_manager' (1ac3f32c-7664-48c4-a70f-d3a163f5dff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:30 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-112307c4-fc75-41eb-919b-953dd4543d93 tempest-GroupSnapshotsV319Test-807137981 None] Created volume successfully. Sep 09 17:55:30 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae Sep 09 17:55:30 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (5bcc8aa9-e0dc-4548-a5d3-68d87dd0a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0dd760-153c-48ce-bf56-910926a762df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0dd760-153c-48ce-bf56-910926a762df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-928145970',display_name='tempest-VolumesGetTest-Volume-1887184765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b460ff5-ea8b-4257-b59d-ada6fcd5053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:30Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49218bca-129d-40b0-b291-15b875a02a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49218bca-129d-40b0-b291-15b875a02a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d42f3f-7113-4556-a1cf-0ce5262d4694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d42f3f-7113-4556-a1cf-0ce5262d4694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b460ff5-ea8b-4257-b59d-ada6fcd5053c', 'volume_name': 'volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a019abd-8d06-4603-9f6e-169ea4051f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a019abd-8d06-4603-9f6e-169ea4051f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:30 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b77687-2827-48d6-801b-9d1e0050c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:30 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Volume 7b460ff5-ea8b-4257-b59d-ada6fcd5053c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c', 'volume_size': 1} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-928145970',display_name='tempest-VolumesGetTest-Volume-1887184765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b460ff5-ea8b-4257-b59d-ada6fcd5053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c0318ac9ab4bf39c5b3e4bc8d6fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:30Z,use_quota=True,user_id='65970ab7e6e3415fb9b92be7143a182c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Creating volume 7b460ff5-ea8b-4257-b59d-ada6fcd5053c {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:30 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae" returned: 0 in 0.489s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:30 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c 1073741824 Sep 09 17:55:30 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:30 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae Sep 09 17:55:30 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:30 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-94010022-c07b-4b33-94ea-2e4cfb8319ae" returned: 0 in 0.254s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-quobyte-94010022-c07b-4b33-94ea-2e4cfb8319ae" released by "delete_volume" :: held 0.809s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Created reservations ['6371a4ca-93d8-4980-8ef2-1e0b28cecb92', '5cd380ea-18b3-4c0c-90af-beb89c2bf6d2', '36c68fcd-2276-4227-bd2e-d730d0673413', '6df7c709-240d-4b07-a68d-fd16d140edf6'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:30 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:30 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:31 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c 1073741824" returned: 0 in 0.463s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:31 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c Sep 09 17:55:31 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:31 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.298s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:31 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Deleted volume successfully. Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-be4f2d7f-545f-4ad4-8829-b901396eeb65 tempest-VolumeDependencyTests-1205920761 None] Lock "cinder-94010022-c07b-4b33-94ea-2e4cfb8319ae-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:31 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c" returned: 0 in 0.377s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b77687-2827-48d6-801b-9d1e0050c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887ae716-7d8b-4809-910c-29005e3a482d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:31 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Volume volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c (7b460ff5-ea8b-4257-b59d-ada6fcd5053c): created successfully Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887ae716-7d8b-4809-910c-29005e3a482d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Flow 'volume_create_manager' (5bcc8aa9-e0dc-4548-a5d3-68d87dd0a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:31 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-17fcbdb1-2c8c-4477-99b0-635eee31fddc tempest-VolumesGetTest-927547854 None] Created volume successfully. Sep 09 17:55:31 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] GroupSnapshot f540131b-625a-497f-9b16-8e5f8b778fdc: creating. Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Group snapshot f540131b-625a-497f-9b16-8e5f8b778fdc: creating. {{(pid=87202) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Creating offline snapshot bcad12d6-b80e-41cc-a7d8-32a69392f975 of volume 40c5d1db-ecc3-4650-9164-59f550d92e9b {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e73510-2850-4d8a-b6ab-fe435395bf3f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:32 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b Sep 09 17:55:32 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:32 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b" returned: 0 in 0.425s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:32 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 1G Sep 09 17:55:32 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-7b460ff5-ea8b-4257-b59d-ada6fcd5053c-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:32 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Lock "cinder-7b460ff5-ea8b-4257-b59d-ada6fcd5053c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 1G" returned: 0 in 0.535s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c5d1db-ecc3-4650-9164-59f550d92e9b -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:32 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c5d1db-ecc3-4650-9164-59f550d92e9b -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 Sep 09 17:55:32 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-7b460ff5-ea8b-4257-b59d-ada6fcd5053c" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-7b460ff5-ea8b-4257-b59d-ada6fcd5053c" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5417a403-ba39-4d98-aa4f-6bac87202c51]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:33 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c Sep 09 17:55:33 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:33 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40c5d1db-ecc3-4650-9164-59f550d92e9b -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975" returned: 0 in 0.388s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:33 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:33 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 Sep 09 17:55:33 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:33 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c" returned: 0 in 0.457s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:33 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c Sep 09 17:55:33 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:33 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:33 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.info Sep 09 17:55:33 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:33 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7b460ff5-ea8b-4257-b59d-ada6fcd5053c" returned: 0 in 0.288s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-7b460ff5-ea8b-4257-b59d-ada6fcd5053c" released by "delete_volume" :: held 0.793s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Created reservations ['491f3b0a-51d1-4804-8848-e85a9ac7f751', 'edaa7503-21fa-4ae1-a1df-0ae9b9dd3c6f', '104d5259-e9a2-4ebf-b61e-cee4fa276b9b', '08c046c3-9311-404e-9fef-169fd8e1de58'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:34 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:34 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:34 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.info" returned: 0 in 0.443s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:34 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:34 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.info Sep 09 17:55:34 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Lock "cinder-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Acquiring lock "cinder-quobyte-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:34 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.406s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Deleted volume successfully. Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb16dca8-13e3-4a35-ba80-32534234c66b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fbf9aa21-f65b-44f4-8fde-999b813e8e8d tempest-VolumesGetTest-927547854 None] Lock "cinder-7b460ff5-ea8b-4257-b59d-ada6fcd5053c-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:34 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 Sep 09 17:55:34 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:34 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.info" returned: 0 in 0.573s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.770s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e65000ed-bbe4-42b3-b2a4-c8cacfd0e6f5 tempest-GroupSnapshotsV319Test-807137981 None] group_snapshot f540131b-625a-497f-9b16-8e5f8b778fdc: created successfully Sep 09 17:55:34 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08" returned: 0 in 0.568s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:35 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08 Sep 09 17:55:35 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Flow 'volume_create_manager' (20b92335-87fa-4f48-a083-7f6d909b508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c7b184-7276-461d-869f-a7e00258da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c7b184-7276-461d-869f-a7e00258da46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0321e65-d2ff-4a05-9131-7c98f6a48e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba00ad6fdef845dd89d867218042ce70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:35Z,use_quota=True,user_id='ae22812cb6d945569e5caa198c752014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b120396-dd48-4bf6-b127-454f072423b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b120396-dd48-4bf6-b127-454f072423b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588a903c-7464-4126-a8d6-82134251a131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588a903c-7464-4126-a8d6-82134251a131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0321e65-d2ff-4a05-9131-7c98f6a48e52', 'volume_name': 'volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba095352-08ae-472a-84cb-a43666e7ca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba095352-08ae-472a-84cb-a43666e7ca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea202c7-26b3-4a87-a2ec-68f53c559570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:35 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Volume a0321e65-d2ff-4a05-9131-7c98f6a48e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52', 'volume_size': 1} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0321e65-d2ff-4a05-9131-7c98f6a48e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba00ad6fdef845dd89d867218042ce70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:35Z,use_quota=True,user_id='ae22812cb6d945569e5caa198c752014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Creating volume a0321e65-d2ff-4a05-9131-7c98f6a48e52 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:35 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:35 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 1073741824 Sep 09 17:55:35 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:35 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Lock "cinder-quobyte-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08" released by "delete_volume" :: held 1.026s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Created reservations ['92c7518c-9990-4e7c-aa35-3fbdfaf0c5b6', '8178b266-5416-40c1-bd5f-af4471e3167d', '2603e215-691e-462e-b6a0-2b7ae2716b83', '581b59ff-fedb-4e31-a9b3-ec92c37ac1ef'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:35 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:35 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] group_snapshot f540131b-625a-497f-9b16-8e5f8b778fdc: deleting Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] group_snapshot f540131b-625a-497f-9b16-8e5f8b778fdc: deleting {{(pid=87202) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Acquiring lock "cinder-quobyte-40c5d1db-ecc3-4650-9164-59f550d92e9b" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Lock "cinder-quobyte-40c5d1db-ecc3-4650-9164-59f550d92e9b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Acquiring lock "cinder-quobyte-bcad12d6-b80e-41cc-a7d8-32a69392f975" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Lock "cinder-quobyte-bcad12d6-b80e-41cc-a7d8-32a69392f975" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Deleting offline snapshot bcad12d6-b80e-41cc-a7d8-32a69392f975 of volume 40c5d1db-ecc3-4650-9164-59f550d92e9b {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] snapshot_file for this snap is: volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e5746-6a70-482a-8f06-faac20d8cc23]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:35 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 1073741824" returned: 0 in 0.624s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:36 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:36 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Deleted volume successfully. Sep 09 17:55:36 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 Sep 09 17:55:36 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-765cc63a-a740-43cd-8cca-32e67a3cc252 tempest-VolumesGetTest-927547854 None] Lock "cinder-98d48ed0-56b7-4fd7-8d9a-f65d0d6a2d08-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:36 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 Sep 09 17:55:36 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:36 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52" returned: 0 in 0.306s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea202c7-26b3-4a87-a2ec-68f53c559570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922e3599-f070-4e2a-8e59-871800027d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:36 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Volume volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 (a0321e65-d2ff-4a05-9131-7c98f6a48e52): created successfully Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922e3599-f070-4e2a-8e59-871800027d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Flow 'volume_create_manager' (20b92335-87fa-4f48-a083-7f6d909b508c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:36 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ac82ac66-dee3-4e6f-89b7-09803efc5196 tempest-CinderUnicodeTest-1879918906 None] Created volume successfully. Sep 09 17:55:36 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975" returned: 0 in 0.521s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40c5d1db-ecc3-4650-9164-59f550d92e9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4694aead-6b87-4eef-9f26-764cc5de4101]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:36 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b Sep 09 17:55:36 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:36 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:36 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 Sep 09 17:55:36 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:37 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975" returned: 0 in 0.390s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:37 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975 Sep 09 17:55:37 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:37 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b.bcad12d6-b80e-41cc-a7d8-32a69392f975" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Lock "cinder-quobyte-bcad12d6-b80e-41cc-a7d8-32a69392f975" released by "_delete_snapshot" :: held 1.639s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Lock "cinder-quobyte-40c5d1db-ecc3-4650-9164-59f550d92e9b" released by "delete_snapshot" :: held 1.683s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:37 devstack cinder-volume[87202]: WARNING cinder.quota [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-914090858 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-914090858, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:55:37 devstack cinder-volume[87202]: WARNING cinder.quota [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-914090858 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-914090858, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] Created reservations ['6fcceea6-743c-491e-8a05-1e8bee51bc1d', 'ceb3b905-8456-4c7d-a53e-1042734f59b0', 'acccae1d-bddb-44d7-a0a1-3063f8915fac', 'f5d0ad69-bde0-4b8a-8b65-26477d92831b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-45c0d316-f5ad-4a1a-a34f-7acf2b961a5e tempest-GroupSnapshotsV319Test-807137981 None] group_snapshot f540131b-625a-497f-9b16-8e5f8b778fdc: deleted successfully Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Flow 'volume_create_manager' (be381b49-a63d-4b8c-83b8-f36165d20729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf266fa-fd7b-4424-a303-fc1edddeb9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf266fa-fd7b-4424-a303-fc1edddeb9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2081409260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7f98c3-810d-48b7-a814-abc3eeef7f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba00ad6fdef845dd89d867218042ce70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:38Z,use_quota=True,user_id='ae22812cb6d945569e5caa198c752014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8255c63-847a-4fc8-8ddf-fa3ccf12d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8255c63-847a-4fc8-8ddf-fa3ccf12d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b8baaf-95ac-40f7-b5ed-0f31d0741f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b8baaf-95ac-40f7-b5ed-0f31d0741f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7f98c3-810d-48b7-a814-abc3eeef7f51', 'volume_name': 'volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c826feaa-50b6-4107-b278-d06bb5e457db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c826feaa-50b6-4107-b278-d06bb5e457db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effadb94-2c48-4946-a345-a2a6ef28a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Volume ef7f98c3-810d-48b7-a814-abc3eeef7f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51', 'volume_size': 1} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2081409260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7f98c3-810d-48b7-a814-abc3eeef7f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba00ad6fdef845dd89d867218042ce70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:38Z,use_quota=True,user_id='ae22812cb6d945569e5caa198c752014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Creating volume ef7f98c3-810d-48b7-a814-abc3eeef7f51 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:37 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:37 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 1073741824 Sep 09 17:55:37 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:38 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 1073741824" returned: 0 in 0.494s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:38 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 Sep 09 17:55:38 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Acquiring lock "cinder-quobyte-40c5d1db-ecc3-4650-9164-59f550d92e9b" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Lock "cinder-quobyte-40c5d1db-ecc3-4650-9164-59f550d92e9b" acquired by "delete_volume" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a4f3e9-3eb8-4d41-a56c-10fe6bb9b6ba]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:38 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b Sep 09 17:55:38 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:38 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51" returned: 0 in 0.332s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (effadb94-2c48-4946-a345-a2a6ef28a265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff10e98-03af-4381-a43f-670b03c4be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:38 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Volume volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 (ef7f98c3-810d-48b7-a814-abc3eeef7f51): created successfully Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff10e98-03af-4381-a43f-670b03c4be4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Flow 'volume_create_manager' (be381b49-a63d-4b8c-83b8-f36165d20729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ee5de2d7-55c4-4940-b069-ed15003f35ce tempest-CinderUnicodeTest-1879918906 None] Created volume successfully. Sep 09 17:55:38 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b" returned: 0 in 0.426s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:39 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b Sep 09 17:55:39 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:39 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c5d1db-ecc3-4650-9164-59f550d92e9b" returned: 0 in 0.254s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Lock "cinder-quobyte-40c5d1db-ecc3-4650-9164-59f550d92e9b" released by "delete_volume" :: held 0.759s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Created reservations ['16daf507-fbb2-4f08-96e3-68f344418b17'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:39 devstack cinder-volume[87202]: WARNING cinder.quota [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-914090858 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-914090858, it is now deprecated. Please use the default quota class for default quota. Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Created reservations ['70d63156-c7b9-4523-b0a9-72093754fb92', '83209485-4912-4847-9db6-6cf7c0eef987', '7448ac46-f3f9-47b2-9bf6-b78b2f2641ed', '118cac99-6753-4615-b824-664a5725c893'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:39 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:39 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:39 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.269s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:39 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:39 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-34fc6b99-4343-47a8-9643-1cfe09e84b12 tempest-GroupSnapshotsV319Test-807137981 None] Delete group completed successfully. Sep 09 17:55:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Creating offline snapshot 3f79f864-9f36-46ed-913a-97bac25b2b62 of volume ef7f98c3-810d-48b7-a814-abc3eeef7f51 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:55:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efdf88a-5da3-47cb-81e4-7fd5154f62a8]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:40 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 Sep 09 17:55:40 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:40 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51" returned: 0 in 0.408s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:40 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 1G Sep 09 17:55:40 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:41 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 1G" returned: 0 in 0.437s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:41 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 Sep 09 17:55:41 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:41 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62" returned: 0 in 0.381s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:41 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 is being set with open permissions: ugo+rw Sep 09 17:55:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:41 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 Sep 09 17:55:41 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:41 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62" returned: 0 in 0.275s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:41 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.info Sep 09 17:55:41 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:42 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.info" returned: 0 in 0.316s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:42 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.info is being set with open permissions: ugo+rw Sep 09 17:55:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:42 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.info Sep 09 17:55:42 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:42 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.info" returned: 0 in 0.284s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e02d53f3-1619-45bf-967e-60b248b7ffd7 tempest-CinderUnicodeTest-1879918906 None] Create snapshot completed successfully Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "cinder-3f79f864-9f36-46ed-913a-97bac25b2b62-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-3f79f864-9f36-46ed-913a-97bac25b2b62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "cinder-quobyte-ef7f98c3-810d-48b7-a814-abc3eeef7f51" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-quobyte-ef7f98c3-810d-48b7-a814-abc3eeef7f51" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "cinder-quobyte-3f79f864-9f36-46ed-913a-97bac25b2b62" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-quobyte-3f79f864-9f36-46ed-913a-97bac25b2b62" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Deleting offline snapshot 3f79f864-9f36-46ed-913a-97bac25b2b62 of volume ef7f98c3-810d-48b7-a814-abc3eeef7f51 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] snapshot_file for this snap is: volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1e870a-f414-4ec6-9b22-e0c98dd9c6e9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:43 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 Sep 09 17:55:43 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:43 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62" returned: 0 in 0.470s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:44 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e2cb7f-905c-4be3-9bb1-0a2fa2cb4c6a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:44 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 Sep 09 17:55:44 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:44 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51" returned: 0 in 0.549s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:44 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 Sep 09 17:55:44 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:45 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62" returned: 0 in 0.538s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:45 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62 Sep 09 17:55:45 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=261,cinder:DELETE=16,cinder:SELECT=203,cinder:INSERT=64 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Flow 'volume_create_manager' (3e2e55fe-0739-45ba-9db8-f9fe7881a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046bd4fa-5bb9-4d60-96cf-00d3384afd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:45 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51.3f79f864-9f36-46ed-913a-97bac25b2b62" returned: 0 in 0.377s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046bd4fa-5bb9-4d60-96cf-00d3384afd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-947564414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d241c8-b518-4c47-ac3a-1ea32a07984a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4d19d7ea3a4898ac0fe394e0eded12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:45Z,use_quota=True,user_id='63a9d82250a840879d76f16dc4745e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e5197e-bbe7-427c-9e67-fee1929efbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e5197e-bbe7-427c-9e67-fee1929efbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c67702-133b-415a-8423-e3a8d9bd9278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c67702-133b-415a-8423-e3a8d9bd9278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d241c8-b518-4c47-ac3a-1ea32a07984a', 'volume_name': 'volume-39d241c8-b518-4c47-ac3a-1ea32a07984a', 'volume_size': 2}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4705c10f-1474-4851-b5e5-ace4835096ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4705c10f-1474-4851-b5e5-ace4835096ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238de4b8-d14d-49e0-9f57-d77ef8942415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:45 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Volume 39d241c8-b518-4c47-ac3a-1ea32a07984a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d241c8-b518-4c47-ac3a-1ea32a07984a', 'volume_size': 2} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-947564414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d241c8-b518-4c47-ac3a-1ea32a07984a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4d19d7ea3a4898ac0fe394e0eded12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:45Z,use_quota=True,user_id='63a9d82250a840879d76f16dc4745e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Creating volume 39d241c8-b518-4c47-ac3a-1ea32a07984a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:45 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a 2147483648 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:45 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a 2147483648 Sep 09 17:55:45 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-quobyte-3f79f864-9f36-46ed-913a-97bac25b2b62" released by "_delete_snapshot" :: held 2.154s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-quobyte-ef7f98c3-810d-48b7-a814-abc3eeef7f51" released by "delete_snapshot" :: held 2.182s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Created reservations ['411a97c9-9d79-4471-8b6f-56050f6afcd5', '83c2427f-a41c-4ae3-a7f3-1e49d54e2050', '4dda96c6-3f34-4361-ab1f-1ba4af26e56f', 'dca33975-430a-4985-b870-215b8d5d44f6'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Delete snapshot completed successfully. Sep 09 17:55:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1db54550-c620-42af-b571-9616e8e6bc78 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-3f79f864-9f36-46ed-913a-97bac25b2b62-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:46 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a 2147483648" returned: 0 in 0.626s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:46 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a Sep 09 17:55:46 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:46 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a" returned: 0 in 0.259s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238de4b8-d14d-49e0-9f57-d77ef8942415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d241c8-b518-4c47-ac3a-1ea32a07984a', 'volume_size': 2}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f6d793-39e3-459d-a886-ad51348d9d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Volume volume-39d241c8-b518-4c47-ac3a-1ea32a07984a (39d241c8-b518-4c47-ac3a-1ea32a07984a): created successfully Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f6d793-39e3-459d-a886-ad51348d9d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Flow 'volume_create_manager' (3e2e55fe-0739-45ba-9db8-f9fe7881a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-fef39d63-eb1d-4343-9bd6-f25afeeebe8f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Created volume successfully. Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "cinder-ef7f98c3-810d-48b7-a814-abc3eeef7f51-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-ef7f98c3-810d-48b7-a814-abc3eeef7f51-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "cinder-quobyte-ef7f98c3-810d-48b7-a814-abc3eeef7f51" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-quobyte-ef7f98c3-810d-48b7-a814-abc3eeef7f51" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d713b-6757-43cb-a988-953ad4478d80]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:46 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 Sep 09 17:55:46 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Flow 'volume_create_manager' (d9955339-b0e8-4d6b-8c27-70dffecfedaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc877d7-e331-4e32-bd6c-ff7d3c9f8184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc877d7-e331-4e32-bd6c-ff7d3c9f8184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-773193494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b80eaef-282c-4833-b5dc-3e590e7fa6d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6da492fe9d445c840230bf5253d76f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:47Z,use_quota=True,user_id='23bc8abf6bd74e9b880f266c5b875a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee12fb4-05ef-4d4a-8797-f4d44764031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee12fb4-05ef-4d4a-8797-f4d44764031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bd2d89-b7c0-4133-a23e-68f01519cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03bd2d89-b7c0-4133-a23e-68f01519cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b80eaef-282c-4833-b5dc-3e590e7fa6d7', 'volume_name': 'volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121832ae-4a0b-4734-b69f-5c44d4f4df21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121832ae-4a0b-4734-b69f-5c44d4f4df21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b27979-bf83-471c-8e23-0e705fad0d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:47 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7', 'volume_size': 1} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-773193494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b80eaef-282c-4833-b5dc-3e590e7fa6d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6da492fe9d445c840230bf5253d76f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:47Z,use_quota=True,user_id='23bc8abf6bd74e9b880f266c5b875a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Creating volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:47 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:47 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51" returned: 0 in 0.389s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:47 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 1073741824 Sep 09 17:55:47 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:47 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51 Sep 09 17:55:47 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:47 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ef7f98c3-810d-48b7-a814-abc3eeef7f51" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-quobyte-ef7f98c3-810d-48b7-a814-abc3eeef7f51" released by "delete_volume" :: held 0.685s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Created reservations ['61bfb0a6-8473-4834-a89d-26396eba858b', 'f68d081b-b6a6-4ab8-be95-a56b70f52c22', '0896d96b-3d70-4a29-b705-9a11b9546f65', '804eedfe-791e-40b8-bb79-f6648b9ca982'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:47 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:47 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:47 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 1073741824" returned: 0 in 0.506s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:47 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 Sep 09 17:55:47 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:47 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.313s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Deleted volume successfully. Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "cinder-a0321e65-d2ff-4a05-9131-7c98f6a48e52-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3bf37a6c-d4de-4e8f-900f-5f8c510cb4b5 tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-ef7f98c3-810d-48b7-a814-abc3eeef7f51-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-a0321e65-d2ff-4a05-9131-7c98f6a48e52-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "cinder-quobyte-a0321e65-d2ff-4a05-9131-7c98f6a48e52" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-quobyte-a0321e65-d2ff-4a05-9131-7c98f6a48e52" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:48 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" returned: 0 in 0.341s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.357s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6063507f-91b0-4518-a96f-ab5a2c387491]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b27979-bf83-471c-8e23-0e705fad0d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cff1b64-418c-436d-9b06-152b32ea36ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Creating offline snapshot b43c5fde-33f8-49d4-a31f-895229af0aab of volume 39d241c8-b518-4c47-ac3a-1ea32a07984a {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:55:48 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Volume volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 (6b80eaef-282c-4833-b5dc-3e590e7fa6d7): created successfully Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cff1b64-418c-436d-9b06-152b32ea36ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Flow 'volume_create_manager' (d9955339-b0e8-4d6b-8c27-70dffecfedaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[061b04fc-2adb-4f7b-99ea-d7e196238ed4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:48 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ccfeb495-2840-4abf-aae2-94aa68a760b2 tempest-SnapshotsActionsTest-1363534716 None] Created volume successfully. Sep 09 17:55:48 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 Sep 09 17:55:48 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:48 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a Sep 09 17:55:48 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:48 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52" returned: 0 in 0.423s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:48 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52 Sep 09 17:55:48 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:48 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a" returned: 0 in 0.412s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab 2G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:48 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab 2G Sep 09 17:55:48 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Flow 'volume_create_manager' (b2607d25-a130-4194-9fc2-7c9bef8b031f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61d6bdb-e568-4b45-a5ee-7e6077cc769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61d6bdb-e568-4b45-a5ee-7e6077cc769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-955364290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d494f1b0-3849-41ef-a094-f4a48b9f99be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1399c659dc1b4f6eb4720696b67b23da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:49Z,use_quota=True,user_id='90c1eec2d1d1488fb461a7b922a61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f874cf6d-1c8d-4feb-b799-933c81493b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f874cf6d-1c8d-4feb-b799-933c81493b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff09eb5-eb14-416d-802b-9cbdddccd7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff09eb5-eb14-416d-802b-9cbdddccd7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd494f1b0-3849-41ef-a094-f4a48b9f99be', 'volume_name': 'volume-d494f1b0-3849-41ef-a094-f4a48b9f99be', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ee17ee-335b-46cc-afa1-c23f68647f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ee17ee-335b-46cc-afa1-c23f68647f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513f1a68-2320-436c-b4c6-4b0cb619dd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:48 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Volume d494f1b0-3849-41ef-a094-f4a48b9f99be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d494f1b0-3849-41ef-a094-f4a48b9f99be', 'volume_size': 1} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:48 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a0321e65-d2ff-4a05-9131-7c98f6a48e52" returned: 0 in 0.259s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-quobyte-a0321e65-d2ff-4a05-9131-7c98f6a48e52" released by "delete_volume" :: held 0.734s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Created reservations ['d932fdf8-f899-41bd-b101-e9e4931a5c84', 'd535c89f-d5b8-490f-ae85-2659aafc461e', '41977863-8fce-469f-9321-1b90b70ebaf1', '52a95916-4968-4f29-9fb8-3128e3711080'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:48 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:48 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:48 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab 2G" returned: 0 in 0.437s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d241c8-b518-4c47-ac3a-1ea32a07984a -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:48 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d241c8-b518-4c47-ac3a-1ea32a07984a -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab Sep 09 17:55:48 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:49 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.270s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:49 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Deleted volume successfully. Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5394d1ce-1e6f-46bf-9235-03839db6f89d tempest-CinderUnicodeTest-1879918906 None] Lock "cinder-a0321e65-d2ff-4a05-9131-7c98f6a48e52-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:49 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39d241c8-b518-4c47-ac3a-1ea32a07984a -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab" returned: 0 in 0.362s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:49 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab is being set with open permissions: ugo+rw Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:49 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab Sep 09 17:55:49 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:49 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab" returned: 0 in 0.274s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:49 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.info Sep 09 17:55:49 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:49 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.info" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:49 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.info is being set with open permissions: ugo+rw Sep 09 17:55:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:49 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.info Sep 09 17:55:49 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:50 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.info" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-955364290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d494f1b0-3849-41ef-a094-f4a48b9f99be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1399c659dc1b4f6eb4720696b67b23da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:49Z,use_quota=True,user_id='90c1eec2d1d1488fb461a7b922a61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Creating volume d494f1b0-3849-41ef-a094-f4a48b9f99be {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:50 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:50 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be 1073741824 Sep 09 17:55:50 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-feb38bc2-624a-482d-84e7-ccb13df92f9b tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Create snapshot completed successfully Sep 09 17:55:50 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be 1073741824" returned: 0 in 0.446s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:50 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be Sep 09 17:55:50 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "cinder-b43c5fde-33f8-49d4-a31f-895229af0aab-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-b43c5fde-33f8-49d4-a31f-895229af0aab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "cinder-quobyte-39d241c8-b518-4c47-ac3a-1ea32a07984a" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:50 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be" returned: 0 in 0.274s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-quobyte-39d241c8-b518-4c47-ac3a-1ea32a07984a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "cinder-quobyte-b43c5fde-33f8-49d4-a31f-895229af0aab" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.568s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Creating offline snapshot 278cecd0-31dd-4948-be80-1ed9777fa254 of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513f1a68-2320-436c-b4c6-4b0cb619dd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d494f1b0-3849-41ef-a094-f4a48b9f99be', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be168990-21fd-4856-a057-ee2577beaecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-quobyte-b43c5fde-33f8-49d4-a31f-895229af0aab" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Deleting offline snapshot b43c5fde-33f8-49d4-a31f-895229af0aab of volume 39d241c8-b518-4c47-ac3a-1ea32a07984a {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] snapshot_file for this snap is: volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb19bc99-2409-4253-a306-2737ab90efa6]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc3116-c372-4f2d-b7d3-f79feee19459]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:51 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Volume volume-d494f1b0-3849-41ef-a094-f4a48b9f99be (d494f1b0-3849-41ef-a094-f4a48b9f99be): created successfully Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be168990-21fd-4856-a057-ee2577beaecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Flow 'volume_create_manager' (b2607d25-a130-4194-9fc2-7c9bef8b031f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5f84ae99-7e0f-4065-a5a5-e769112ce3c2 tempest-AttachVolumeTestJSON-2024533298 None] Created volume successfully. Sep 09 17:55:51 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 Sep 09 17:55:51 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:51 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab Sep 09 17:55:51 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:51 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" returned: 0 in 0.408s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:51 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab" returned: 0 in 0.410s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39d241c8-b518-4c47-ac3a-1ea32a07984a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:51 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 1G Sep 09 17:55:51 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[66791c19-ed49-4a72-8dda-39bf6e68581c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:51 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a Sep 09 17:55:51 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:51 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a" returned: 0 in 0.426s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:51 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 1G" returned: 0 in 0.509s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:51 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab Sep 09 17:55:51 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:51 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:55:51 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:52 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.404s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:52 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 is being set with open permissions: ugo+rw Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:52 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:55:52 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:52 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab" returned: 0 in 0.482s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:52 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab Sep 09 17:55:52 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-3e0bd049-f271-49d9-b0ee-bd6be9f5b698 req-597338c5-eb10-439d-8c4e-e75deed1074d tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:52 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:52 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a.b43c5fde-33f8-49d4-a31f-895229af0aab" returned: 0 in 0.260s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-quobyte-b43c5fde-33f8-49d4-a31f-895229af0aab" released by "_delete_snapshot" :: held 1.710s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-quobyte-39d241c8-b518-4c47-ac3a-1ea32a07984a" released by "delete_snapshot" :: held 1.765s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:52 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.info Sep 09 17:55:52 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Created reservations ['d3df4757-7bc8-4dd5-b063-4de7fdff62a2', '5d38e366-90f2-4e4a-9265-9852cda428a0', '2d83e287-9107-45df-9b58-e15ac9ac68f5', '20fa7de3-c578-4b7e-b41e-581a0894c6a8'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Delete snapshot completed successfully. Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ce2459df-f0b7-4b00-9112-46f6e5215886 tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-b43c5fde-33f8-49d4-a31f-895229af0aab-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:52 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.info" returned: 0 in 0.266s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:52 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.info is being set with open permissions: ugo+rw Sep 09 17:55:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:52 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.info Sep 09 17:55:52 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Flow 'volume_create_manager' (df59df28-8135-4b79-bdd7-20a5f06cc0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa74894-4d6b-40ba-a7d4-7194277b8d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa74894-4d6b-40ba-a7d4-7194277b8d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108104292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd43ad6-738f-4971-baa8-fbd8111a2f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629f3d8f6c1741a88db96a7c4fc4a196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:53Z,use_quota=True,user_id='08437119c575409680c64bd1ff2d8814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1dd648-40fb-4c30-aad4-ab4f972b68db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1dd648-40fb-4c30-aad4-ab4f972b68db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e00593-f30f-492b-bd39-232883d510f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e00593-f30f-492b-bd39-232883d510f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd43ad6-738f-4971-baa8-fbd8111a2f90', 'volume_name': 'volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9850968b-5bf0-4007-8731-98f3bde5aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9850968b-5bf0-4007-8731-98f3bde5aed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507b2bdd-64c5-4590-9ff5-af6338451ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Volume 1bd43ad6-738f-4971-baa8-fbd8111a2f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90', 'volume_size': 1} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "cinder-39d241c8-b518-4c47-ac3a-1ea32a07984a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-39d241c8-b518-4c47-ac3a-1ea32a07984a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "cinder-quobyte-39d241c8-b518-4c47-ac3a-1ea32a07984a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-quobyte-39d241c8-b518-4c47-ac3a-1ea32a07984a" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:53 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.info" returned: 0 in 0.289s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee76d1-c565-4a02-adf7-57eb62202931]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-3e0bd049-f271-49d9-b0ee-bd6be9f5b698 req-597338c5-eb10-439d-8c4e-e75deed1074d tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.716s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-3e0bd049-f271-49d9-b0ee-bd6be9f5b698 req-597338c5-eb10-439d-8c4e-e75deed1074d tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.148s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108104292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd43ad6-738f-4971-baa8-fbd8111a2f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629f3d8f6c1741a88db96a7c4fc4a196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:53Z,use_quota=True,user_id='08437119c575409680c64bd1ff2d8814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Creating volume 1bd43ad6-738f-4971-baa8-fbd8111a2f90 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:53 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-869ec258-2f90-4ccc-b4d8-70d86d80027a tempest-SnapshotsActionsTest-1363534716 None] Create snapshot completed successfully Sep 09 17:55:53 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 1073741824 Sep 09 17:55:53 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-3e0bd049-f271-49d9-b0ee-bd6be9f5b698 req-597338c5-eb10-439d-8c4e-e75deed1074d tempest-AttachVolumeTestJSON-2024533298 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-d494f1b0-3849-41ef-a094-f4a48b9f99be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bf62fa9-660e-4f2c-a5dc-bff9e65a7971', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:55:53 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a Sep 09 17:55:53 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-3e0bd049-f271-49d9-b0ee-bd6be9f5b698 req-597338c5-eb10-439d-8c4e-e75deed1074d tempest-AttachVolumeTestJSON-2024533298 None] attachment_update completed successfully. Sep 09 17:55:53 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a" returned: 0 in 0.412s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:53 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a Sep 09 17:55:53 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:53 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 1073741824" returned: 0 in 0.464s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:53 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 Sep 09 17:55:53 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:54 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-39d241c8-b518-4c47-ac3a-1ea32a07984a" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-quobyte-39d241c8-b518-4c47-ac3a-1ea32a07984a" released by "delete_volume" :: held 0.847s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Created reservations ['297cb8f8-bace-4451-a81b-22318ee7c978', '974e1cb6-847e-45b3-b332-c9d7235a24ee', 'a092a881-5aef-4338-938f-51937a13632f', 'ecc257d9-eb85-4953-9c15-4b4eb972ff93'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:54 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90" returned: 0 in 0.376s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507b2bdd-64c5-4590-9ff5-af6338451ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b847088-3fda-4d90-9802-675cbaa76f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:54 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Volume volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 (1bd43ad6-738f-4971-baa8-fbd8111a2f90): created successfully Sep 09 17:55:54 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:54 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b847088-3fda-4d90-9802-675cbaa76f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Flow 'volume_create_manager' (df59df28-8135-4b79-bdd7-20a5f06cc0b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-09f986d0-bcd8-4ee2-89bb-073f637bf095 tempest-ProjectReaderTests-2019674240 None] Created volume successfully. Sep 09 17:55:54 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.299s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Deleted volume successfully. Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f26a1edd-c233-4c89-9c71-0148ed7dd90f tempest-VolumesSnapshotNegativeTestJSON-1531713998 None] Lock "cinder-39d241c8-b518-4c47-ac3a-1ea32a07984a-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Creating offline snapshot 9a1e188b-2695-4ee9-a5ba-f7f25434ba37 of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0db29-1c94-45b0-92b9-597f8fe675f5]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:54 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:55:54 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:55 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.424s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:55 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 1G Sep 09 17:55:55 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Flow 'volume_create_manager' (58e1c6b8-8f41-44ce-9a58-77b016d8ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1941e1a1-590e-4d45-9f8f-401f3d427ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1941e1a1-590e-4d45-9f8f-401f3d427ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-892939726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33aa811a-a338-4ebd-9d8d-56821132df95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1399c659dc1b4f6eb4720696b67b23da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:55Z,use_quota=True,user_id='90c1eec2d1d1488fb461a7b922a61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748f53ab-5ff8-4922-b717-4e530896408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748f53ab-5ff8-4922-b717-4e530896408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd4a2d1-7a1d-4225-87aa-7042689746ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd4a2d1-7a1d-4225-87aa-7042689746ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33aa811a-a338-4ebd-9d8d-56821132df95', 'volume_name': 'volume-33aa811a-a338-4ebd-9d8d-56821132df95', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d414e1a3-7599-4ddf-8809-0a6b3beba9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d414e1a3-7599-4ddf-8809-0a6b3beba9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b8aeab-8942-4784-bd24-5e0464671ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Volume 33aa811a-a338-4ebd-9d8d-56821132df95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33aa811a-a338-4ebd-9d8d-56821132df95', 'volume_size': 1} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Acquiring lock "cinder-1bd43ad6-738f-4971-baa8-fbd8111a2f90-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Lock "cinder-1bd43ad6-738f-4971-baa8-fbd8111a2f90-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Acquiring lock "cinder-quobyte-1bd43ad6-738f-4971-baa8-fbd8111a2f90" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Lock "cinder-quobyte-1bd43ad6-738f-4971-baa8-fbd8111a2f90" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[695d2948-18a0-489a-b2ea-4ee6a81d4d64]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:55 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 Sep 09 17:55:55 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:55 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 1G" returned: 0 in 0.563s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:55 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 Sep 09 17:55:55 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:56 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90" returned: 0 in 0.386s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:56 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90 Sep 09 17:55:56 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:56 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37" returned: 0 in 0.351s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:56 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 is being set with open permissions: ugo+rw Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:56 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 Sep 09 17:55:56 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:56 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1bd43ad6-738f-4971-baa8-fbd8111a2f90" returned: 0 in 0.291s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Lock "cinder-quobyte-1bd43ad6-738f-4971-baa8-fbd8111a2f90" released by "delete_volume" :: held 0.723s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Created reservations ['f1a80d9f-7e59-4695-ace0-a49f39c23f0c', '6fed5654-d37f-4f4b-85d6-60a5725c04ed', '8f599efa-3136-48fd-968b-53b787526398', '32d53617-011c-4c51-be97-e8fdbba69ccc'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:56 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37" returned: 0 in 0.279s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:56 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:55:56 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.765s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-892939726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33aa811a-a338-4ebd-9d8d-56821132df95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1399c659dc1b4f6eb4720696b67b23da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:55Z,use_quota=True,user_id='90c1eec2d1d1488fb461a7b922a61e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Creating volume 33aa811a-a338-4ebd-9d8d-56821132df95 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:56 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:56 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 1073741824 Sep 09 17:55:56 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8a10d946-f81c-4707-ba7b-cdd4ef575687 tempest-SnapshotsActionsTest-1363534716 None] Create snapshot completed successfully Sep 09 17:55:56 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.288s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:55:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Deleted volume successfully. Sep 09 17:55:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8171ee29-d7d0-4e2d-bad7-25207f55cff3 tempest-ProjectReaderTests-2019674240 None] Lock "cinder-1bd43ad6-738f-4971-baa8-fbd8111a2f90-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-9a1e188b-2695-4ee9-a5ba-f7f25434ba37-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-9a1e188b-2695-4ee9-a5ba-f7f25434ba37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-quobyte-9a1e188b-2695-4ee9-a5ba-f7f25434ba37" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-9a1e188b-2695-4ee9-a5ba-f7f25434ba37" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Deleting offline snapshot 9a1e188b-2695-4ee9-a5ba-f7f25434ba37 of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] snapshot_file for this snap is: volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e632efc-56b1-4286-bbd4-01aca9af1976]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:57 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 1073741824" returned: 0 in 0.637s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:57 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 Sep 09 17:55:57 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:57 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 Sep 09 17:55:57 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Flow 'volume_create_manager' (1763c782-e1bf-4ac3-9741-6e5c0d5a69bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed29939-03a8-464c-b559-fd23f0163efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed29939-03a8-464c-b559-fd23f0163efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746097070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fc1747-314d-46ea-b6cd-8aeb2501cb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629f3d8f6c1741a88db96a7c4fc4a196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:57Z,use_quota=True,user_id='08437119c575409680c64bd1ff2d8814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e6847e-f63b-42c7-9589-1601a3c45a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e6847e-f63b-42c7-9589-1601a3c45a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002375fc-0a01-4013-abf4-d7ecf4236947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002375fc-0a01-4013-abf4-d7ecf4236947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34fc1747-314d-46ea-b6cd-8aeb2501cb14', 'volume_name': 'volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a468b987-305c-44f2-ae1b-5866c4ed2d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a468b987-305c-44f2-ae1b-5866c4ed2d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1201a59-e60c-4f8f-a196-d4812c9943f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:57 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Volume 34fc1747-314d-46ea-b6cd-8aeb2501cb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14', 'volume_size': 1} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:57 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95" returned: 0 in 0.284s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.047s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-746097070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fc1747-314d-46ea-b6cd-8aeb2501cb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629f3d8f6c1741a88db96a7c4fc4a196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:55:57Z,use_quota=True,user_id='08437119c575409680c64bd1ff2d8814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Creating volume 34fc1747-314d-46ea-b6cd-8aeb2501cb14 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:55:57 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:57 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 1073741824 Sep 09 17:55:57 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b8aeab-8942-4784-bd24-5e0464671ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33aa811a-a338-4ebd-9d8d-56821132df95', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d152201b-8a75-4675-ad45-ef8aec15a475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:57 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Volume volume-33aa811a-a338-4ebd-9d8d-56821132df95 (33aa811a-a338-4ebd-9d8d-56821132df95): created successfully Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d152201b-8a75-4675-ad45-ef8aec15a475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Flow 'volume_create_manager' (58e1c6b8-8f41-44ce-9a58-77b016d8ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:57 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-db546a70-90c6-458a-aeae-6806b953a13f tempest-AttachVolumeTestJSON-2024533298 None] Created volume successfully. Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37" returned: 0 in 0.461s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b87c254-4cf3-4fd1-ab4a-98f0b66edf5b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:57 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:55:57 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:58 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 1073741824" returned: 0 in 0.499s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:58 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.425s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:58 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 Sep 09 17:55:58 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:58 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 Sep 09 17:55:58 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:58 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14" returned: 0 in 0.298s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1201a59-e60c-4f8f-a196-d4812c9943f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e5958a-89cd-4b05-979a-b759a0a6b294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:55:58 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Volume volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 (34fc1747-314d-46ea-b6cd-8aeb2501cb14): created successfully Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e5958a-89cd-4b05-979a-b759a0a6b294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Flow 'volume_create_manager' (1763c782-e1bf-4ac3-9741-6e5c0d5a69bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:55:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f12fc356-7e47-4870-8858-a003fbe39778 tempest-ProjectReaderTests-2019674240 None] Created volume successfully. Sep 09 17:55:58 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37" returned: 0 in 0.457s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:58 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37 Sep 09 17:55:58 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:58 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.9a1e188b-2695-4ee9-a5ba-f7f25434ba37" returned: 0 in 0.347s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-9a1e188b-2695-4ee9-a5ba-f7f25434ba37" released by "_delete_snapshot" :: held 1.823s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" released by "delete_snapshot" :: held 1.868s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Created reservations ['4db5c755-76f1-4662-9c9f-0f18ae60233e', '0e191611-0ba6-47ec-8e3d-b77ee332312a', 'cff430fe-1725-45e1-b240-3153070a80bd', '59e3657f-5f1d-423d-bfde-6e4b0b2ba1a7'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:55:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Delete snapshot completed successfully. Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-076173ce-4b63-4694-aad9-3b377c4d2339 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-9a1e188b-2695-4ee9-a5ba-f7f25434ba37-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Acquiring lock "cinder-34fc1747-314d-46ea-b6cd-8aeb2501cb14-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Lock "cinder-34fc1747-314d-46ea-b6cd-8aeb2501cb14-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Acquiring lock "cinder-quobyte-34fc1747-314d-46ea-b6cd-8aeb2501cb14" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Lock "cinder-quobyte-34fc1747-314d-46ea-b6cd-8aeb2501cb14" acquired by "delete_volume" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57c6e68-d3c4-43b0-abc7-6c3d99e88f87]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Creating offline snapshot bd729e31-fd15-42c1-bb39-a2f7e203cc20 of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:55:59 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 Sep 09 17:55:59 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a68563f-1bdb-43eb-88b4-8b2377e59c53]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:55:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-06b77395-6cdf-4d71-ba16-e4c9c89eb183 req-d1b4a424-7c95-486a-9335-7a7511fe4dd2 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:55:59 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:55:59 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:00 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14" returned: 0 in 0.446s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:00 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14 Sep 09 17:56:00 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:00 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.456s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:00 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 1G Sep 09 17:56:00 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:00 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-34fc1747-314d-46ea-b6cd-8aeb2501cb14" returned: 0 in 0.274s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Lock "cinder-quobyte-34fc1747-314d-46ea-b6cd-8aeb2501cb14" released by "delete_volume" :: held 0.792s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Created reservations ['da5f0a64-9add-432d-939c-acb090533b63', 'b8bf90c6-0e38-489a-ab36-d7129c39701c', '449d496f-80d2-4042-8e6c-3dc7de6c75de', '061445f6-c6ff-4980-a2fa-4fb0e68e576a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:00 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:00 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:00 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 1G" returned: 0 in 0.560s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:00 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 Sep 09 17:56:00 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:00 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.337s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Deleted volume successfully. Sep 09 17:56:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c2d686b3-c217-47a5-aec1-0dcde9ac6d7a tempest-ProjectReaderTests-2019674240 None] Lock "cinder-34fc1747-314d-46ea-b6cd-8aeb2501cb14-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:01 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20" returned: 0 in 0.310s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:01 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 is being set with open permissions: ugo+rw Sep 09 17:56:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:01 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 Sep 09 17:56:01 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:01 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.738s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-06b77395-6cdf-4d71-ba16-e4c9c89eb183 req-d1b4a424-7c95-486a-9335-7a7511fe4dd2 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.523s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-06b77395-6cdf-4d71-ba16-e4c9c89eb183 req-d1b4a424-7c95-486a-9335-7a7511fe4dd2 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-372e5428-77b6-4ac9-b37f-e86489763714 tempest-SnapshotsActionsTest-1363534716 None] Create snapshot completed successfully Sep 09 17:56:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-06b77395-6cdf-4d71-ba16-e4c9c89eb183 req-d1b4a424-7c95-486a-9335-7a7511fe4dd2 tempest-AttachVolumeTestJSON-2024533298 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-33aa811a-a338-4ebd-9d8d-56821132df95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '295e188c-fa6f-43dc-9c47-d7af39ba010e', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:56:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-06b77395-6cdf-4d71-ba16-e4c9c89eb183 req-d1b4a424-7c95-486a-9335-7a7511fe4dd2 tempest-AttachVolumeTestJSON-2024533298 None] attachment_update completed successfully. Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-bd729e31-fd15-42c1-bb39-a2f7e203cc20-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-bd729e31-fd15-42c1-bb39-a2f7e203cc20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-quobyte-bd729e31-fd15-42c1-bb39-a2f7e203cc20" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-bd729e31-fd15-42c1-bb39-a2f7e203cc20" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Deleting offline snapshot bd729e31-fd15-42c1-bb39-a2f7e203cc20 of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] snapshot_file for this snap is: volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded486ac-4132-40fa-abe2-81614160115f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:02 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 Sep 09 17:56:02 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:02 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20" returned: 0 in 0.487s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740d2f8-a8f0-4ec6-8d05-ef22701dd987]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:02 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:56:02 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:03 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.537s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:03 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 Sep 09 17:56:03 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:03 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20" returned: 0 in 0.561s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:03 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20 Sep 09 17:56:03 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:04 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-62aeeb74-ade3-47e8-bea8-f1458c2e035f req-7f9f14d9-fc09-47d0-9947-f253ac9f636a tempest-AttachVolumeTestJSON-2024533298 None] Terminate volume connection completed successfully. Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-62aeeb74-ade3-47e8-bea8-f1458c2e035f req-7f9f14d9-fc09-47d0-9947-f253ac9f636a tempest-AttachVolumeTestJSON-2024533298 None] Deleting attachment 2bf62fa9-660e-4f2c-a5dc-bff9e65a7971. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:56:04 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.bd729e31-fd15-42c1-bb39-a2f7e203cc20" returned: 0 in 0.385s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-bd729e31-fd15-42c1-bb39-a2f7e203cc20" released by "_delete_snapshot" :: held 2.133s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" released by "delete_snapshot" :: held 2.169s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Created reservations ['f2169701-b2d7-4a0c-9788-336bf8812e30', '160b0ee1-31d9-4592-81ea-c0ffed3e7624', '9cdaa571-4e7e-4949-8b37-474db7834236', '27a2c3ee-6834-45f6-9148-3185368f76be'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:04 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Delete snapshot completed successfully. Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37b04ef1-6913-4f39-bf78-abbc2167c4aa tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-bd729e31-fd15-42c1-bb39-a2f7e203cc20-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:05 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:05 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:05 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.447s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-daabed59-00dd-4569-bb84-227b075b6d88 req-82a01641-c237-494e-b9ab-56bce29e11db tempest-AttachVolumeTestJSON-2024533298 None] Terminate volume connection completed successfully. Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-daabed59-00dd-4569-bb84-227b075b6d88 req-82a01641-c237-494e-b9ab-56bce29e11db tempest-AttachVolumeTestJSON-2024533298 None] Deleting attachment 295e188c-fa6f-43dc-9c47-d7af39ba010e. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Creating offline snapshot 31b3b25a-bcd4-4663-b539-063c4dbc3c3e of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8a27d0-7264-4411-b8ce-606fccf5259c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:06 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:56:06 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:06 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.427s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:06 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e 1G Sep 09 17:56:06 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:07 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e 1G" returned: 0 in 0.642s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:07 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e Sep 09 17:56:07 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:07 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e" returned: 0 in 0.447s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:07 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e is being set with open permissions: ugo+rw Sep 09 17:56:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:07 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e Sep 09 17:56:07 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:07 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e" returned: 0 in 0.414s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:07 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9d281389-a250-469a-990d-5d054f14c451 tempest-SnapshotsActionsTest-1363534716 None] Create snapshot completed successfully Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-31b3b25a-bcd4-4663-b539-063c4dbc3c3e-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-31b3b25a-bcd4-4663-b539-063c4dbc3c3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-quobyte-31b3b25a-bcd4-4663-b539-063c4dbc3c3e" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-31b3b25a-bcd4-4663-b539-063c4dbc3c3e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Deleting offline snapshot 31b3b25a-bcd4-4663-b539-063c4dbc3c3e of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] snapshot_file for this snap is: volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ec79ca-1203-4489-8167-13b42f4d1e6e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:09 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e Sep 09 17:56:09 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:09 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e" returned: 0 in 0.463s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce8efc1-522b-4eda-860d-a7a9bcbf183b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:09 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:56:09 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:10 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.393s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:10 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e Sep 09 17:56:10 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:10 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e" returned: 0 in 0.515s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:10 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e Sep 09 17:56:10 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:11 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.31b3b25a-bcd4-4663-b539-063c4dbc3c3e" returned: 0 in 0.399s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-31b3b25a-bcd4-4663-b539-063c4dbc3c3e" released by "_delete_snapshot" :: held 1.921s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" released by "delete_snapshot" :: held 1.948s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:11 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Created reservations ['052cf1c6-3e9d-40e9-8efd-392dd7efe64e', '9dda312d-800c-4a11-a864-7e88f9e19dac', 'df0fb28e-64c8-4706-94ea-873cd1d44d32', '90ba15b3-b12d-445c-b190-c57061441d82'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Delete snapshot completed successfully. Sep 09 17:56:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c0cce399-640c-4ad0-961c-5a44b215bc87 tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-31b3b25a-bcd4-4663-b539-063c4dbc3c3e-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:12 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=194,cinder:INSERT=61,cinder:UPDATE=206,cinder:DELETE=14 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:56:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Creating offline snapshot 7e314418-0033-4163-bd96-26211cde5d1a of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:56:12 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e22c4d-be00-4519-b6f9-4049f0ffda3e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:13 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:56:13 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:13 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.438s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:13 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a 1G Sep 09 17:56:13 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:13 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a 1G" returned: 0 in 0.539s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:13 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a Sep 09 17:56:13 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:14 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:14 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a is being set with open permissions: ugo+rw Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:14 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a Sep 09 17:56:14 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:14 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a" returned: 0 in 0.272s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:14 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-018ec4ad-0cd5-4b50-9a6b-3f3b6e343fca tempest-SnapshotsActionsTest-1363534716 None] Create snapshot completed successfully Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-7e314418-0033-4163-bd96-26211cde5d1a-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-7e314418-0033-4163-bd96-26211cde5d1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Acquiring lock "cinder-quobyte-7e314418-0033-4163-bd96-26211cde5d1a" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-7e314418-0033-4163-bd96-26211cde5d1a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Deleting offline snapshot 7e314418-0033-4163-bd96-26211cde5d1a of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] snapshot_file for this snap is: volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8078406-8bc6-41aa-9c70-22cd2773ce83]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:15 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a Sep 09 17:56:15 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:15 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a" returned: 0 in 0.405s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f7665-41e6-4ecf-91af-a2b3342c9ca7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:15 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:56:15 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:15 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.465s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:15 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a Sep 09 17:56:15 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:16 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a" returned: 0 in 0.435s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:16 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a Sep 09 17:56:16 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:16 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.7e314418-0033-4163-bd96-26211cde5d1a" returned: 0 in 0.336s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-7e314418-0033-4163-bd96-26211cde5d1a" released by "_delete_snapshot" :: held 1.771s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" released by "delete_snapshot" :: held 1.795s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:16 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Created reservations ['36e46ff1-df61-4b80-89d4-9bd1e2ad918a', 'da7eb12d-200f-4169-82f2-656e868bdb8e', '17d8db22-1193-4a43-9b54-60e210e5cf31', '7236b4a8-0277-439d-9a47-f60bd40e3edd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Delete snapshot completed successfully. Sep 09 17:56:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1d0e6918-42de-4b79-8e23-8638f56e267a tempest-SnapshotsActionsTest-388823121 None] Lock "cinder-7e314418-0033-4163-bd96-26211cde5d1a-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "cinder-33aa811a-a338-4ebd-9d8d-56821132df95-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-33aa811a-a338-4ebd-9d8d-56821132df95-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "cinder-quobyte-33aa811a-a338-4ebd-9d8d-56821132df95" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-quobyte-33aa811a-a338-4ebd-9d8d-56821132df95" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd74a03-269a-485e-b9c7-c48cec719c8c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:17 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 Sep 09 17:56:17 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "cinder-278cecd0-31dd-4948-be80-1ed9777fa254-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-278cecd0-31dd-4948-be80-1ed9777fa254-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "cinder-quobyte-278cecd0-31dd-4948-be80-1ed9777fa254" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-quobyte-278cecd0-31dd-4948-be80-1ed9777fa254" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Deleting offline snapshot 278cecd0-31dd-4948-be80-1ed9777fa254 of volume 6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] snapshot_file for this snap is: volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57c3d04-6e21-40f0-8248-af4d84e691ed]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:18 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:56:18 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:18 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95" returned: 0 in 0.545s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:18 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95 Sep 09 17:56:18 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:18 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.487s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:18 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f6de6a-f5f7-4967-b1fd-a0579b05f641]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-33aa811a-a338-4ebd-9d8d-56821132df95" returned: 0 in 0.320s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-quobyte-33aa811a-a338-4ebd-9d8d-56821132df95" released by "delete_volume" :: held 0.942s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Created reservations ['70d09d18-15b8-4baf-85ca-6c222c4a32f5', '5e84343c-181f-48e8-a496-913221edcee6', '01523f11-41cc-4f51-b47a-9d7ad29b4ef0', 'ce6a0184-d1e6-4278-946f-b2e24c0e8ddd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:18 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 Sep 09 17:56:18 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:18 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:18 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:18 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" returned: 0 in 0.570s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:18 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:56:18 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:19 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.371s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Deleted volume successfully. Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aea7e156-4b43-440d-9989-0530803fb89a tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-33aa811a-a338-4ebd-9d8d-56821132df95-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:19 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.527s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:19 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254 Sep 09 17:56:19 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "cinder-d494f1b0-3849-41ef-a094-f4a48b9f99be-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-d494f1b0-3849-41ef-a094-f4a48b9f99be-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:19 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7.278cecd0-31dd-4948-be80-1ed9777fa254" returned: 0 in 0.398s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "cinder-quobyte-d494f1b0-3849-41ef-a094-f4a48b9f99be" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-quobyte-278cecd0-31dd-4948-be80-1ed9777fa254" released by "_delete_snapshot" :: held 2.169s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-quobyte-d494f1b0-3849-41ef-a094-f4a48b9f99be" acquired by "delete_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" released by "delete_snapshot" :: held 2.220s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f87b2c0-0d5c-4cbb-b676-03fb67f0656e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Created reservations ['e1eccd92-3e70-4e5f-9a42-dbb7756e4cc6', 'b0b634ef-abab-4c69-8402-8643a46648ca', 'e19fd3a6-c12c-46ba-aa0c-39f36ac4feff', 'd0dc3357-a4a2-4b7b-9465-7478de2de8c2'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:20 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be Sep 09 17:56:20 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:20 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Delete snapshot completed successfully. Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64095767-2cf8-4006-a167-4ab226de33d3 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-278cecd0-31dd-4948-be80-1ed9777fa254-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:20 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be" returned: 0 in 0.444s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:20 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be Sep 09 17:56:20 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:20 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d494f1b0-3849-41ef-a094-f4a48b9f99be" returned: 0 in 0.286s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-quobyte-d494f1b0-3849-41ef-a094-f4a48b9f99be" released by "delete_volume" :: held 0.795s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:20 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Created reservations ['ec3e7b29-40a0-43fa-a9e4-9893f74ff0ac', '6ea58153-650e-430a-baab-d2e4356352d3', '4a12bc12-88a8-42b4-919d-a1c75180eb07', 'aebbf221-78b6-4d48-b9ad-bd3f70020d66'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:21 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:21 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "cinder-6b80eaef-282c-4833-b5dc-3e590e7fa6d7-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-6b80eaef-282c-4833-b5dc-3e590e7fa6d7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" acquired by "delete_volume" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97bc33f-f342-46d5-8bc7-1d0131b63145]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:21 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.389s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:21 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Deleted volume successfully. Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3b144db4-b727-4e7a-94c6-3b723eb886b1 tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-d494f1b0-3849-41ef-a094-f4a48b9f99be-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:21 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 Sep 09 17:56:21 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:21 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" returned: 0 in 0.437s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:21 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7 Sep 09 17:56:21 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:22 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-quobyte-6b80eaef-282c-4833-b5dc-3e590e7fa6d7" released by "delete_volume" :: held 0.812s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Created reservations ['069bc43b-d711-4e0a-a004-deb6c99f8e57', '2d5edf8d-1b1c-4e21-97ee-6a3fcf79f0f1', '12ee40c5-ffea-4d6d-a1bd-cf71a9d6b83c', 'c9a43f9f-8e8a-43cd-99ca-4f813f447820'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:22 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:22 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "cinder-e31e2c29-35fe-43e5-8212-cce2b80866df-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-e31e2c29-35fe-43e5-8212-cce2b80866df-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "cinder-quobyte-e31e2c29-35fe-43e5-8212-cce2b80866df" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-quobyte-e31e2c29-35fe-43e5-8212-cce2b80866df" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1774cd13-bd89-4c00-ad47-3bb08b8a7a00]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:22 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:22 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df Sep 09 17:56:22 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.387s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Deleted volume successfully. Sep 09 17:56:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f202a352-873b-4bc3-ac7c-9b8b09c635b5 tempest-SnapshotsActionsTest-1363534716 None] Lock "cinder-6b80eaef-282c-4833-b5dc-3e590e7fa6d7-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:23 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df" returned: 0 in 0.575s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:23 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df Sep 09 17:56:23 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:23 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e31e2c29-35fe-43e5-8212-cce2b80866df" returned: 0 in 0.338s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-quobyte-e31e2c29-35fe-43e5-8212-cce2b80866df" released by "delete_volume" :: held 0.992s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Created reservations ['9e9bb952-2833-4b84-abb9-e6e644ffd3ad', '4142bdca-ae56-4d69-8604-31090d59d947', 'ec937084-949e-4dc4-9f87-9d9c9ae94d46', 'ca1bb504-7b65-4081-ade2-56cb30401a11'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:23 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:23 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:23 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.303s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:23 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Deleted volume successfully. Sep 09 17:56:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1e8c7eac-0b31-478c-b848-1918e6fc5079 tempest-AttachVolumeTestJSON-2024533298 None] Lock "cinder-e31e2c29-35fe-43e5-8212-cce2b80866df-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Flow 'volume_create_manager' (1d85aa07-b9d7-402d-a2d1-47827f704bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7ce41-dccc-44ae-a9b9-95f5e18c5836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f7ce41-dccc-44ae-a9b9-95f5e18c5836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1573598735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8585b51-856e-4139-95a6-ba35cd7e7f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b978f1a0b5496ea75f9336175cf1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:32Z,use_quota=True,user_id='d8433eaa57e945e696f91080d0506186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e206960f-f665-42bf-9ed6-6ad5758bd8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e206960f-f665-42bf-9ed6-6ad5758bd8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883c8167-1181-4103-b824-c7fa529be4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883c8167-1181-4103-b824-c7fa529be4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8585b51-856e-4139-95a6-ba35cd7e7f2b', 'volume_name': 'volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbb3850-0f71-4242-ae11-92c58a7a875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbb3850-0f71-4242-ae11-92c58a7a875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0af9c2-ed71-498a-a5d8-e983e9d276d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:32 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Volume a8585b51-856e-4139-95a6-ba35cd7e7f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b', 'volume_size': 1} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1573598735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8585b51-856e-4139-95a6-ba35cd7e7f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b978f1a0b5496ea75f9336175cf1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:32Z,use_quota=True,user_id='d8433eaa57e945e696f91080d0506186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Creating volume a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:56:32 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:32 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b 1073741824 Sep 09 17:56:32 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:32 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b 1073741824" returned: 0 in 0.614s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:33 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b Sep 09 17:56:33 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:33 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b" returned: 0 in 0.282s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:56:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0af9c2-ed71-498a-a5d8-e983e9d276d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a1e7f6-3bd8-4fe6-a782-550967f691e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Volume volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b (a8585b51-856e-4139-95a6-ba35cd7e7f2b): created successfully Sep 09 17:56:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a1e7f6-3bd8-4fe6-a782-550967f691e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Flow 'volume_create_manager' (1d85aa07-b9d7-402d-a2d1-47827f704bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c4a55832-92e6-4a36-9c8c-20b31f56009c tempest-SnapshotDependencyTests-688407190 None] Created volume successfully. Sep 09 17:56:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Creating offline snapshot e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 of volume a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:56:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[601abfb3-f810-4fec-bad6-67c20c411b9c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:34 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b Sep 09 17:56:34 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:35 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b" returned: 0 in 0.502s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:35 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 1G Sep 09 17:56:35 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:35 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 1G" returned: 0 in 0.579s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:35 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 Sep 09 17:56:35 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:36 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" returned: 0 in 0.449s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:36 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 is being set with open permissions: ugo+rw Sep 09 17:56:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:36 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 Sep 09 17:56:36 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:36 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" returned: 0 in 0.345s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:36 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.info Sep 09 17:56:36 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:37 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.info" returned: 0 in 0.330s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:37 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.info is being set with open permissions: ugo+rw Sep 09 17:56:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:37 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.info Sep 09 17:56:37 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:37 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.info" returned: 0 in 0.319s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.666s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-00e0189b-1882-4913-bb9f-68fae842eacc tempest-SnapshotDependencyTests-688407190 None] Create snapshot completed successfully Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Flow 'volume_create_manager' (8683be85-9ca1-4e7a-ae19-7b152eff9fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baded01-4b5d-49bb-a92d-cefd21995501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baded01-4b5d-49bb-a92d-cefd21995501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894cfcb2-9e0f-4529-9254-a1645aa34c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b978f1a0b5496ea75f9336175cf1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e6042bf0-a7c5-47bb-aede-91b9bd30ceb3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:39Z,use_quota=True,user_id='d8433eaa57e945e696f91080d0506186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90aa88c-b957-4244-bf26-1fc62c76f284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90aa88c-b957-4244-bf26-1fc62c76f284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99509175-f69a-4bc1-904d-9bf581445df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99509175-f69a-4bc1-904d-9bf581445df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '894cfcb2-9e0f-4529-9254-a1645aa34c7e', 'volume_name': 'volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e', 'volume_size': 1, 'snapshot_id': 'e6042bf0-a7c5-47bb-aede-91b9bd30ceb3'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418747a6-fc96-4f17-8382-7021ec11f383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418747a6-fc96-4f17-8382-7021ec11f383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cb707b-16cf-43b4-861a-d06593a65d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:38 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Volume 894cfcb2-9e0f-4529-9254-a1645aa34c7e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e', 'volume_size': 1, 'snapshot_id': 'e6042bf0-a7c5-47bb-aede-91b9bd30ceb3'} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-quobyte-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3-894cfcb2-9e0f-4529-9254-a1645aa34c7e" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3-894cfcb2-9e0f-4529-9254-a1645aa34c7e" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Creating volume 894cfcb2-9e0f-4529-9254-a1645aa34c7e from snapshot e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-quobyte-894cfcb2-9e0f-4529-9254-a1645aa34c7e" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-894cfcb2-9e0f-4529-9254-a1645aa34c7e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] snapshot: e6042bf0-a7c5-47bb-aede-91b9bd30ceb3, volume: 894cfcb2-9e0f-4529-9254-a1645aa34c7e, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5837079-0b28-4a35-8a52-0a7b4d4f87a1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:39 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 Sep 09 17:56:39 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:39 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" returned: 0 in 0.633s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:39 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df0d41f-262b-4b8b-a44a-9fb9ea84c7d8]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:39 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b Sep 09 17:56:39 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:40 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b" returned: 0 in 0.647s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:40 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e Sep 09 17:56:40 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Flow 'volume_create_manager' (11d595db-f6fa-4fbc-9552-f07b6310516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48ee4df-ea24-4de1-8f46-913b1858bc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48ee4df-ea24-4de1-8f46-913b1858bc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-86477394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80ff584-e8b8-48bc-a057-07124f096f45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63e7caf7dab848e9b666b7607bc56605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:40Z,use_quota=True,user_id='1238b063e1a74bd3bcb94c0907d190e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b5733f-2fe5-4d20-8630-2ca9f255d2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b5733f-2fe5-4d20-8630-2ca9f255d2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b3a178-ed32-459e-8bc9-3e650541326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b3a178-ed32-459e-8bc9-3e650541326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80ff584-e8b8-48bc-a057-07124f096f45', 'volume_name': 'volume-e80ff584-e8b8-48bc-a057-07124f096f45', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83429ace-eff6-46e7-a9c8-842887a15221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83429ace-eff6-46e7-a9c8-842887a15221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18565cbd-12b8-4082-92fa-77094a817f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:40 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Volume e80ff584-e8b8-48bc-a057-07124f096f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80ff584-e8b8-48bc-a057-07124f096f45', 'volume_size': 1} Sep 09 17:56:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:46 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e" returned: 0 in 5.964s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:56:46 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Converted 1024.00 MB image at 171.67 MB/s Sep 09 17:56:46 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e is being set with open permissions: ugo+rw Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:46 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e Sep 09 17:56:46 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:46 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e" returned: 0 in 0.303s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-894cfcb2-9e0f-4529-9254-a1645aa34c7e" released by "_copy_volume_from_snapshot" :: held 7.688s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=133,cinder:INSERT=39,cinder:UPDATE=147,cinder:DELETE=11 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3-894cfcb2-9e0f-4529-9254-a1645aa34c7e" released by "_create_volume_from_snapshot" :: held 7.834s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.857s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.160s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-86477394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80ff584-e8b8-48bc-a057-07124f096f45,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63e7caf7dab848e9b666b7607bc56605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:40Z,use_quota=True,user_id='1238b063e1a74bd3bcb94c0907d190e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Creating volume e80ff584-e8b8-48bc-a057-07124f096f45 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:56:46 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:46 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 1073741824 Sep 09 17:56:46 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cb707b-16cf-43b4-861a-d06593a65d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e', 'volume_size': 1, 'snapshot_id': 'e6042bf0-a7c5-47bb-aede-91b9bd30ceb3'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74db9550-52c3-4e4d-b682-46651e2f5d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Volume volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e (894cfcb2-9e0f-4529-9254-a1645aa34c7e): created successfully Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74db9550-52c3-4e4d-b682-46651e2f5d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Flow 'volume_create_manager' (8683be85-9ca1-4e7a-ae19-7b152eff9fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5f474500-bb4e-48d3-89ec-28a13aa8127a tempest-SnapshotDependencyTests-688407190 None] Created volume successfully. Sep 09 17:56:47 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 1073741824" returned: 0 in 0.861s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:47 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 Sep 09 17:56:47 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:48 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45" returned: 0 in 0.299s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18565cbd-12b8-4082-92fa-77094a817f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80ff584-e8b8-48bc-a057-07124f096f45', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685908ae-e26b-430c-aae3-ba0794971a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:48 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Volume volume-e80ff584-e8b8-48bc-a057-07124f096f45 (e80ff584-e8b8-48bc-a057-07124f096f45): created successfully Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685908ae-e26b-430c-aae3-ba0794971a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Flow 'volume_create_manager' (11d595db-f6fa-4fbc-9552-f07b6310516f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:48 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b7ecdc7a-c7d9-4aed-8610-dc400c3df97c tempest-VolumesTestJSON-487592141 None] Created volume successfully. Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-quobyte-a8585b51-856e-4139-95a6-ba35cd7e7f2b" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-a8585b51-856e-4139-95a6-ba35cd7e7f2b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-quobyte-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Deleting offline snapshot e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 of volume a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] snapshot_file for this snap is: volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf92697-bf86-4df0-bfbf-186622018d61]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:48 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 Sep 09 17:56:48 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:48 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" returned: 0 in 0.596s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8fcab5-fc2f-47c3-8cdf-29efdb7e5b24]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:49 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b Sep 09 17:56:49 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Flow 'volume_create_manager' (fd602f25-1173-435b-8427-1836d0c6ea0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d366e80-7129-4200-a917-75f3a17f6c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d366e80-7129-4200-a917-75f3a17f6c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-165307361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b1e2c1-0718-4b46-9cc7-65460cd458f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63e7caf7dab848e9b666b7607bc56605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:49Z,use_quota=True,user_id='1238b063e1a74bd3bcb94c0907d190e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015dd3f0-9e27-446a-a9f5-21113f2a3e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015dd3f0-9e27-446a-a9f5-21113f2a3e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed6416d-6980-4461-92fe-2fc007a830d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed6416d-6980-4461-92fe-2fc007a830d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b1e2c1-0718-4b46-9cc7-65460cd458f2', 'volume_name': 'volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c6c4c2-f7b0-489f-895a-0d7a604e86ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c6c4c2-f7b0-489f-895a-0d7a604e86ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80c69dc-cea2-4fca-9ebe-94c0e888a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:49 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Volume e4b1e2c1-0718-4b46-9cc7-65460cd458f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2', 'volume_size': 1} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-165307361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b1e2c1-0718-4b46-9cc7-65460cd458f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63e7caf7dab848e9b666b7607bc56605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:49Z,use_quota=True,user_id='1238b063e1a74bd3bcb94c0907d190e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Creating volume e4b1e2c1-0718-4b46-9cc7-65460cd458f2 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:56:49 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:49 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 1073741824 Sep 09 17:56:49 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:49 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b" returned: 0 in 0.817s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:49 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 Sep 09 17:56:49 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:50 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 1073741824" returned: 0 in 0.637s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:50 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 Sep 09 17:56:50 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:50 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" returned: 0 in 0.580s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:50 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3 Sep 09 17:56:50 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:50 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2" returned: 0 in 0.504s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80c69dc-cea2-4fca-9ebe-94c0e888a270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a80ab-cd8c-4811-a011-4e033224a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:50 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Volume volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 (e4b1e2c1-0718-4b46-9cc7-65460cd458f2): created successfully Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a80ab-cd8c-4811-a011-4e033224a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Flow 'volume_create_manager' (fd602f25-1173-435b-8427-1836d0c6ea0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e0b68e1b-c004-44e8-8822-f9e5452b7c98 tempest-VolumesTestJSON-487592141 None] Created volume successfully. Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Flow 'volume_create_manager' (a6bfa62e-63a0-4fab-9de0-ddc0a9f2d7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f63b3b1-34b0-41fb-8cc2-e8b5ea2a9fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f63b3b1-34b0-41fb-8cc2-e8b5ea2a9fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1985272747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714b8e20-947a-4d8a-a4dc-4ac94f5a2526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143e323707b42bba7c3658c631c5e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:51Z,use_quota=True,user_id='04c1eed82af2410daa098f15b834da55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:50 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab6720-91c1-4a01-806a-89668ac86845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab6720-91c1-4a01-806a-89668ac86845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239664cd-5b85-463b-a180-28b3329c369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239664cd-5b85-463b-a180-28b3329c369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714b8e20-947a-4d8a-a4dc-4ac94f5a2526', 'volume_name': 'volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17226515-ed49-499c-bd07-66dc1aa87f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17226515-ed49-499c-bd07-66dc1aa87f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22117c8-75a1-481c-854a-b5a039a4fb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:50 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Volume 714b8e20-947a-4d8a-a4dc-4ac94f5a2526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526', 'volume_size': 1} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1985272747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714b8e20-947a-4d8a-a4dc-4ac94f5a2526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143e323707b42bba7c3658c631c5e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:51Z,use_quota=True,user_id='04c1eed82af2410daa098f15b834da55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Creating volume 714b8e20-947a-4d8a-a4dc-4ac94f5a2526 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:56:50 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b.e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" returned: 0 in 0.541s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:50 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 1073741824 Sep 09 17:56:50 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3" released by "_delete_snapshot" :: held 2.725s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-a8585b51-856e-4139-95a6-ba35cd7e7f2b" released by "delete_snapshot" :: held 2.758s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Created reservations ['823d967a-943e-462c-9b63-d4c764718ea3', '00980fba-55d2-48de-851d-4941b3d6fe86', 'f9e1b4ab-ad47-4b4c-bf0e-ea16d12a5dc3', 'ed6cc9c6-c434-468e-b602-8b0d16df368f'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Delete snapshot completed successfully. Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2131cff5-542e-4dda-8919-bfe96b0e88bf tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-e6042bf0-a7c5-47bb-aede-91b9bd30ceb3-delete_snapshot" released by "delete_snapshot" :: held 2.922s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:51 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 1073741824" returned: 0 in 0.545s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:51 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 Sep 09 17:56:51 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-a8585b51-856e-4139-95a6-ba35cd7e7f2b-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-a8585b51-856e-4139-95a6-ba35cd7e7f2b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-quobyte-a8585b51-856e-4139-95a6-ba35cd7e7f2b" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-a8585b51-856e-4139-95a6-ba35cd7e7f2b" acquired by "delete_volume" :: waited 0.046s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[25524ca2-0e7d-4086-b7f2-e902f6ae20e9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:51 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526" returned: 0 in 0.404s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22117c8-75a1-481c-854a-b5a039a4fb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e83c8f-3949-46ac-ae74-ff5b8684962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:51 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Volume volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 (714b8e20-947a-4d8a-a4dc-4ac94f5a2526): created successfully Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e83c8f-3949-46ac-ae74-ff5b8684962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Flow 'volume_create_manager' (a6bfa62e-63a0-4fab-9de0-ddc0a9f2d7c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-aee2db28-6663-4077-8121-bac062e3c24c tempest-VolumeQuotasAdminTestJSON-478092571 None] Created volume successfully. Sep 09 17:56:52 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b Sep 09 17:56:52 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:56:52 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Flow 'volume_create_manager' (1c1cb8b2-13e3-4079-a6bb-c3de707fe127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994c559c-0655-4ce8-a30d-9f76b80eb527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b" returned: 0 in 0.541s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (994c559c-0655-4ce8-a30d-9f76b80eb527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-219315747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff2aac7-542a-4d43-b57d-a914b8ede551,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63e7caf7dab848e9b666b7607bc56605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:52Z,use_quota=True,user_id='1238b063e1a74bd3bcb94c0907d190e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:52 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b Sep 09 17:56:52 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe83685-df87-4fe2-b05b-eaf70c905cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe83685-df87-4fe2-b05b-eaf70c905cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1c9c9d-a019-4e25-92c9-26f6bfc765d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f1c9c9d-a019-4e25-92c9-26f6bfc765d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff2aac7-542a-4d43-b57d-a914b8ede551', 'volume_name': 'volume-4ff2aac7-542a-4d43-b57d-a914b8ede551', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f9fcd1-5aa0-4a25-bd48-fd62a1877cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f9fcd1-5aa0-4a25-bd48-fd62a1877cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9faea39d-7562-46d8-b30b-548e935f074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:52 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Volume 4ff2aac7-542a-4d43-b57d-a914b8ede551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff2aac7-542a-4d43-b57d-a914b8ede551', 'volume_size': 1} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-219315747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff2aac7-542a-4d43-b57d-a914b8ede551,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63e7caf7dab848e9b666b7607bc56605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:52Z,use_quota=True,user_id='1238b063e1a74bd3bcb94c0907d190e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Creating volume 4ff2aac7-542a-4d43-b57d-a914b8ede551 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:56:52 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:52 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 1073741824 Sep 09 17:56:52 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:52 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a8585b51-856e-4139-95a6-ba35cd7e7f2b" returned: 0 in 0.259s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-a8585b51-856e-4139-95a6-ba35cd7e7f2b" released by "delete_volume" :: held 0.911s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Created reservations ['11d9c2f9-2ad5-4749-ab71-72b6ade15fe5', 'd927693a-0368-4b70-b43c-a9ebfcc9bf8e', 'eacfae4c-fcd8-4122-bde5-5a9aca0478b0', '9bdd2910-72e2-433b-b8a8-83f4034f5da2'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:52 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:52 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:52 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 1073741824" returned: 0 in 0.541s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Acquiring lock "cinder-714b8e20-947a-4d8a-a4dc-4ac94f5a2526-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "cinder-714b8e20-947a-4d8a-a4dc-4ac94f5a2526-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Acquiring lock "cinder-quobyte-714b8e20-947a-4d8a-a4dc-4ac94f5a2526" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:53 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 Sep 09 17:56:53 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "cinder-quobyte-714b8e20-947a-4d8a-a4dc-4ac94f5a2526" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a08f6-dc7b-441e-940a-211bfb23c730]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:53 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.332s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Deleted volume successfully. Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-71896a84-80bb-404c-be37-f3f32136476c tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-a8585b51-856e-4139-95a6-ba35cd7e7f2b-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:53 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 Sep 09 17:56:53 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:53 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551" returned: 0 in 0.295s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9faea39d-7562-46d8-b30b-548e935f074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff2aac7-542a-4d43-b57d-a914b8ede551', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d8a108-bcfe-447e-8302-e2ce2c8f3e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Volume volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 (4ff2aac7-542a-4d43-b57d-a914b8ede551): created successfully Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d8a108-bcfe-447e-8302-e2ce2c8f3e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Flow 'volume_create_manager' (1c1cb8b2-13e3-4079-a6bb-c3de707fe127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a1910f03-6f95-4eee-b033-c26c3860de64 tempest-VolumesTestJSON-487592141 None] Created volume successfully. Sep 09 17:56:53 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526" returned: 0 in 0.366s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:53 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526 Sep 09 17:56:53 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:53 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-714b8e20-947a-4d8a-a4dc-4ac94f5a2526" returned: 0 in 0.239s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "cinder-quobyte-714b8e20-947a-4d8a-a4dc-4ac94f5a2526" released by "delete_volume" :: held 0.648s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Created reservations ['412480f1-4f82-4f75-8fd3-bb78eba54bf8', '61744dad-9c4c-48de-badc-07c001042de6', 'c952150a-98d3-4744-ab69-8b74c92ad207', '8cd57b9b-9f5c-4518-86c3-82d66d64e693'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-894cfcb2-9e0f-4529-9254-a1645aa34c7e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-894cfcb2-9e0f-4529-9254-a1645aa34c7e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:53 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:53 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "cinder-quobyte-894cfcb2-9e0f-4529-9254-a1645aa34c7e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-894cfcb2-9e0f-4529-9254-a1645aa34c7e" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae42505-b972-459c-9ced-50fa9365ba04]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:54 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e Sep 09 17:56:54 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:54 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.292s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Deleted volume successfully. Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7f2a4c65-4c6f-4b5e-b010-dc12df25101f tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "cinder-714b8e20-947a-4d8a-a4dc-4ac94f5a2526-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:54 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e" returned: 0 in 0.421s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:54 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e Sep 09 17:56:54 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:54 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-894cfcb2-9e0f-4529-9254-a1645aa34c7e" returned: 0 in 0.348s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-quobyte-894cfcb2-9e0f-4529-9254-a1645aa34c7e" released by "delete_volume" :: held 0.827s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Created reservations ['312fde41-c5a3-47a1-8298-a60297439594', 'ef6ff270-2837-4a75-ac0f-aa4ef72d90a9', 'a94d9ac1-62f4-4d1e-b7f8-8a014f54f3aa', '34b8d9e4-2df5-4be6-988b-540a5a23a9f0'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Flow 'volume_create_manager' (dbd864b1-87b6-4e7c-a475-8931ab952427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9354b3a0-aac4-41c6-a7d0-16db9523d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9354b3a0-aac4-41c6-a7d0-16db9523d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-696832179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b458d37-e554-43f0-8085-19d9c2290fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143e323707b42bba7c3658c631c5e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:55Z,use_quota=True,user_id='04c1eed82af2410daa098f15b834da55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040d8e3b-60c3-483a-9e1b-8b834f2ddeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040d8e3b-60c3-483a-9e1b-8b834f2ddeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8025b21-5d40-4b9c-8ce7-8181f8335a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8025b21-5d40-4b9c-8ce7-8181f8335a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b458d37-e554-43f0-8085-19d9c2290fd9', 'volume_name': 'volume-1b458d37-e554-43f0-8085-19d9c2290fd9', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32dfbde2-e0f3-4c68-95d5-4ceff1dcbb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32dfbde2-e0f3-4c68-95d5-4ceff1dcbb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd54d3a-6bb5-4b8a-9b70-b9c4963052a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Volume 1b458d37-e554-43f0-8085-19d9c2290fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b458d37-e554-43f0-8085-19d9c2290fd9', 'volume_size': 1} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-696832179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b458d37-e554-43f0-8085-19d9c2290fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3143e323707b42bba7c3658c631c5e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:56:55Z,use_quota=True,user_id='04c1eed82af2410daa098f15b834da55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Creating volume 1b458d37-e554-43f0-8085-19d9c2290fd9 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:56:55 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:55 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 1073741824 Sep 09 17:56:55 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:55 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:55 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:55 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.353s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Deleted volume successfully. Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-046ddf8d-69b6-4774-9b7e-380cf05a367a tempest-SnapshotDependencyTests-688407190 None] Lock "cinder-894cfcb2-9e0f-4529-9254-a1645aa34c7e-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Acquiring lock "cinder-4ff2aac7-542a-4d43-b57d-a914b8ede551-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Lock "cinder-4ff2aac7-542a-4d43-b57d-a914b8ede551-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:55 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Acquiring lock "cinder-quobyte-4ff2aac7-542a-4d43-b57d-a914b8ede551" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 1073741824" returned: 0 in 0.818s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Lock "cinder-quobyte-4ff2aac7-542a-4d43-b57d-a914b8ede551" acquired by "delete_volume" :: waited 0.039s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6c1004-267d-4b12-91f4-e53172257692]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:55 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 Sep 09 17:56:55 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:56 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 Sep 09 17:56:56 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:56 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9" returned: 0 in 0.347s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd54d3a-6bb5-4b8a-9b70-b9c4963052a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b458d37-e554-43f0-8085-19d9c2290fd9', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc1122c-aac7-4231-bf60-1bfd431a5c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:56:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Volume volume-1b458d37-e554-43f0-8085-19d9c2290fd9 (1b458d37-e554-43f0-8085-19d9c2290fd9): created successfully Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc1122c-aac7-4231-bf60-1bfd431a5c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Flow 'volume_create_manager' (dbd864b1-87b6-4e7c-a475-8931ab952427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:56:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-72884e94-6e87-499c-9713-a8f5aff55c06 tempest-VolumeQuotasAdminTestJSON-478092571 None] Created volume successfully. Sep 09 17:56:56 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551" returned: 0 in 0.454s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:56 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551 Sep 09 17:56:56 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:56 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4ff2aac7-542a-4d43-b57d-a914b8ede551" returned: 0 in 0.260s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Lock "cinder-quobyte-4ff2aac7-542a-4d43-b57d-a914b8ede551" released by "delete_volume" :: held 0.776s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Created reservations ['f32d34a5-4dd0-460a-a5da-924dac63234a', '6fa81f6b-c111-4274-8747-d377fa0ea5fa', '542b9973-acdd-496f-bdc2-46a76ee1b1e1', '772fb7e3-16ba-43e9-8e18-62d13afadd0e'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:56 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:56 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Acquiring lock "cinder-e4b1e2c1-0718-4b46-9cc7-65460cd458f2-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Lock "cinder-e4b1e2c1-0718-4b46-9cc7-65460cd458f2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Acquiring lock "cinder-quobyte-e4b1e2c1-0718-4b46-9cc7-65460cd458f2" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Lock "cinder-quobyte-e4b1e2c1-0718-4b46-9cc7-65460cd458f2" acquired by "delete_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b111d5-f3c6-4ff6-9fb2-854c4e1fa013]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:57 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.485s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Deleted volume successfully. Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-70f8c455-69bb-4370-9b87-f0c0c2ace713 tempest-VolumesTestJSON-487592141 None] Lock "cinder-4ff2aac7-542a-4d43-b57d-a914b8ede551-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:57 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 Sep 09 17:56:57 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:57 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2" returned: 0 in 0.465s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:57 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2 Sep 09 17:56:57 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-638cd0b0-f730-407c-8c21-715559fcb86a tempest-VolumeQuotasAdminTestJSON-1632552066 None] Transfer volume completed successfully. Sep 09 17:56:58 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e4b1e2c1-0718-4b46-9cc7-65460cd458f2" returned: 0 in 0.355s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Lock "cinder-quobyte-e4b1e2c1-0718-4b46-9cc7-65460cd458f2" released by "delete_volume" :: held 0.893s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Created reservations ['58e4a68a-bc16-4415-a722-db45a89ff876', 'c4e354f1-651f-424b-89a2-70667b0f9292', 'd33518c0-b5ea-437e-8ea4-798ae118057b', '8d3d9037-edc3-467e-a366-a6eb2c27016d'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:58 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:58 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Acquiring lock "cinder-e80ff584-e8b8-48bc-a057-07124f096f45-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Lock "cinder-e80ff584-e8b8-48bc-a057-07124f096f45-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Acquiring lock "cinder-quobyte-e80ff584-e8b8-48bc-a057-07124f096f45" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Lock "cinder-quobyte-e80ff584-e8b8-48bc-a057-07124f096f45" acquired by "delete_volume" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2072c75e-50c9-4047-877c-9af06878801f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:58 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 Sep 09 17:56:58 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Acquiring lock "cinder-1b458d37-e554-43f0-8085-19d9c2290fd9-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Lock "cinder-1b458d37-e554-43f0-8085-19d9c2290fd9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:58 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.567s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Acquiring lock "cinder-quobyte-1b458d37-e554-43f0-8085-19d9c2290fd9" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:56:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Deleted volume successfully. Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Lock "cinder-quobyte-1b458d37-e554-43f0-8085-19d9c2290fd9" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9633bbc2-8260-4d0d-87e8-552f70f3e2a6 tempest-VolumesTestJSON-487592141 None] Lock "cinder-e4b1e2c1-0718-4b46-9cc7-65460cd458f2-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f3331d-2d2e-46b3-b81f-eab4fd83fe28]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:56:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:59 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 Sep 09 17:56:59 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:59 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45" returned: 0 in 0.579s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:59 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45 Sep 09 17:56:59 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:59 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9" returned: 0 in 0.445s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:59 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9 Sep 09 17:56:59 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:59 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e80ff584-e8b8-48bc-a057-07124f096f45" returned: 0 in 0.283s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Lock "cinder-quobyte-e80ff584-e8b8-48bc-a057-07124f096f45" released by "delete_volume" :: held 0.938s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Created reservations ['de4d4ef5-812b-4dc8-ae3c-7376bff54d4a', 'aedd3ad2-2143-4d91-9762-41994eec3e4d', 'd5991eed-66bf-4295-9d02-8e02a70df8e7', 'd5dcf4e0-5d88-47b4-a894-317615d25f4b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:56:59 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1b458d37-e554-43f0-8085-19d9c2290fd9" returned: 0 in 0.315s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:56:59 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:56:59 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Lock "cinder-quobyte-1b458d37-e554-43f0-8085-19d9c2290fd9" released by "delete_volume" :: held 0.813s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:56:59 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Created reservations ['ff2d55f9-52e8-4a1a-9b26-88117d00366c', '13969114-6606-4ea5-82a0-e098b9fe6dc3', '28668ff4-4d99-4fa5-a038-e14d6d74395e', '1ea848d0-1b02-45cc-bcab-8bd42a0a13ea'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:00 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:00 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:00 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.412s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Deleted volume successfully. Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-52c05ae5-bf82-4054-b062-a476120f7fee tempest-VolumesTestJSON-487592141 None] Lock "cinder-e80ff584-e8b8-48bc-a057-07124f096f45-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:00 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.304s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Deleted volume successfully. Sep 09 17:57:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-55a78294-36ea-4eb3-9fdc-eb4a9132bc51 tempest-VolumeQuotasAdminTestJSON-227939882 None] Lock "cinder-1b458d37-e554-43f0-8085-19d9c2290fd9-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:57:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:05 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:05 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-17680983-31c3-437f-bc99-a9dd9147ee3c tempest-GroupsV320Test-777936452 None] Group tempest-GroupsV320Test-Group-737790866: creating Sep 09 17:57:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-17680983-31c3-437f-bc99-a9dd9147ee3c tempest-GroupsV320Test-777936452 None] Group tempest-GroupsV320Test-Group-737790866: created successfully Sep 09 17:57:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-17680983-31c3-437f-bc99-a9dd9147ee3c tempest-GroupsV320Test-777936452 None] Create group completed successfully. Sep 09 17:57:05 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.447s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:57:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:57:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Created reservations ['187c353d-0797-4bf1-8c60-68d6c6cdaed1'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:07 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:07 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:07 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.349s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:07 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:07 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f5db3cd3-74a1-4902-b67c-9949d87b3529 tempest-GroupsV320Test-777936452 None] Delete group completed successfully. Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Flow 'volume_create_manager' (0cb3b868-69a8-4c71-b125-2c6812ada203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb4d05d-fdaf-4bb6-b19c-295585e4896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb4d05d-fdaf-4bb6-b19c-295585e4896a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-810868265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7a6c7a-8a67-4658-84d1-448c2887ab0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369602adf4d04624bbb778eb78f2fbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:12Z,use_quota=True,user_id='d5e7a69be5884e43ac76897355a261f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6730a34-c6e3-4c3f-9180-c8d7c56f38de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6730a34-c6e3-4c3f-9180-c8d7c56f38de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb03e42-6216-4d0a-967e-c83581f30f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb03e42-6216-4d0a-967e-c83581f30f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7a6c7a-8a67-4658-84d1-448c2887ab0d', 'volume_name': 'volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a5c625-426d-4878-a154-125fb6573791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a5c625-426d-4878-a154-125fb6573791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1b0435-07e9-4c6a-a6e5-37d34840b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:12 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Volume 4d7a6c7a-8a67-4658-84d1-448c2887ab0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d', 'volume_size': 1} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-810868265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7a6c7a-8a67-4658-84d1-448c2887ab0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369602adf4d04624bbb778eb78f2fbae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:12Z,use_quota=True,user_id='d5e7a69be5884e43ac76897355a261f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Creating volume 4d7a6c7a-8a67-4658-84d1-448c2887ab0d {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:12 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:12 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d 1073741824 Sep 09 17:57:12 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:12 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d 1073741824" returned: 0 in 0.492s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=105,cinder:UPDATE=136,cinder:DELETE=8,cinder:INSERT=34 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:57:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:12 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d Sep 09 17:57:12 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:13 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d" returned: 0 in 0.320s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1b0435-07e9-4c6a-a6e5-37d34840b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe9be00-c44a-4898-9d18-a0ff9a8aa312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:13 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Volume volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d (4d7a6c7a-8a67-4658-84d1-448c2887ab0d): created successfully Sep 09 17:57:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe9be00-c44a-4898-9d18-a0ff9a8aa312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Flow 'volume_create_manager' (0cb3b868-69a8-4c71-b125-2c6812ada203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0bb02c22-f82f-472a-972e-4a5f0324fa32 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Created volume successfully. Sep 09 17:57:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-1c3fc041-3efc-4088-8404-a99a6589e0fe req-69c411b8-32d8-4a70-8f0b-26234b3939c1 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-1c3fc041-3efc-4088-8404-a99a6589e0fe req-69c411b8-32d8-4a70-8f0b-26234b3939c1 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-1c3fc041-3efc-4088-8404-a99a6589e0fe req-69c411b8-32d8-4a70-8f0b-26234b3939c1 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-1c3fc041-3efc-4088-8404-a99a6589e0fe req-69c411b8-32d8-4a70-8f0b-26234b3939c1 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c76c76b-6f24-4b74-a068-9220972a9482', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:57:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-1c3fc041-3efc-4088-8404-a99a6589e0fe req-69c411b8-32d8-4a70-8f0b-26234b3939c1 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] attachment_update completed successfully. Sep 09 17:57:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-398c2105-d2ba-46b6-b259-536e609fd4c0 req-0048d1ef-2cd6-4fe6-b70c-03ae66add2b0 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Terminate volume connection completed successfully. Sep 09 17:57:19 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-398c2105-d2ba-46b6-b259-536e609fd4c0 req-0048d1ef-2cd6-4fe6-b70c-03ae66add2b0 tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Deleting attachment 4c76c76b-6f24-4b74-a068-9220972a9482. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:57:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Acquiring lock "cinder-4d7a6c7a-8a67-4658-84d1-448c2887ab0d-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "cinder-4d7a6c7a-8a67-4658-84d1-448c2887ab0d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Acquiring lock "cinder-quobyte-4d7a6c7a-8a67-4658-84d1-448c2887ab0d" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "cinder-quobyte-4d7a6c7a-8a67-4658-84d1-448c2887ab0d" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373c2ff-05ac-4a7b-9e1d-0661c80d5c27]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:20 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d Sep 09 17:57:20 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:20 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d" returned: 0 in 0.402s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:20 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d Sep 09 17:57:20 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:21 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4d7a6c7a-8a67-4658-84d1-448c2887ab0d" returned: 0 in 0.408s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "cinder-quobyte-4d7a6c7a-8a67-4658-84d1-448c2887ab0d" released by "delete_volume" :: held 0.865s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Created reservations ['79596753-d4fa-487f-b13b-b31075b64c50', '6bf0dd44-95f5-48c2-8839-558a29ee0212', 'fcc76dc3-b751-4282-930f-5f1711b7c04f', 'd4c694c7-e8d8-4bd1-a2a6-651b02740212'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:21 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:21 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:21 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.353s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:21 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Deleted volume successfully. Sep 09 17:57:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9012c859-7c88-4358-ac79-0e3ffe550f8e tempest-TestServerVolumeAttachScenarioOldVersion-1759512591 None] Lock "cinder-4d7a6c7a-8a67-4658-84d1-448c2887ab0d-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Flow 'volume_create_manager' (29c63477-2e3d-44f5-ba7b-bab266e63679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dbfb2a-f0ea-4fdf-8cbd-412a05e4e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dbfb2a-f0ea-4fdf-8cbd-412a05e4e00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1262163236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f0097e-8b72-4959-878c-0568397406e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751fbb090ecf498382f36efa89769284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:31Z,use_quota=True,user_id='22ff158f96d74f7ea2824fd4f92b62b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a36bf6-d9ef-4018-ada7-345a4b764e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a36bf6-d9ef-4018-ada7-345a4b764e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63799e59-f226-42ca-a645-359623d208e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63799e59-f226-42ca-a645-359623d208e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f0097e-8b72-4959-878c-0568397406e7', 'volume_name': 'volume-f9f0097e-8b72-4959-878c-0568397406e7', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de0d488-4194-4dbd-9d12-09d545d3eddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de0d488-4194-4dbd-9d12-09d545d3eddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3e0f7f-ffff-49b4-8c3f-6777ce40458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:31 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Volume f9f0097e-8b72-4959-878c-0568397406e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f0097e-8b72-4959-878c-0568397406e7', 'volume_size': 1} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1262163236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f0097e-8b72-4959-878c-0568397406e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='751fbb090ecf498382f36efa89769284',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:31Z,use_quota=True,user_id='22ff158f96d74f7ea2824fd4f92b62b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Creating volume f9f0097e-8b72-4959-878c-0568397406e7 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:31 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:31 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 1073741824 Sep 09 17:57:31 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:31 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 1073741824" returned: 0 in 0.509s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:31 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 Sep 09 17:57:31 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:32 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7" returned: 0 in 0.299s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3e0f7f-ffff-49b4-8c3f-6777ce40458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f0097e-8b72-4959-878c-0568397406e7', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deee16d0-d511-4282-aed4-0bf0514c337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:32 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Volume volume-f9f0097e-8b72-4959-878c-0568397406e7 (f9f0097e-8b72-4959-878c-0568397406e7): created successfully Sep 09 17:57:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deee16d0-d511-4282-aed4-0bf0514c337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Flow 'volume_create_manager' (29c63477-2e3d-44f5-ba7b-bab266e63679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:32 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-03986eae-21b3-4e67-bd3a-cad7dfa40c8c tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Created volume successfully. Sep 09 17:57:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Acquiring lock "cinder-f9f0097e-8b72-4959-878c-0568397406e7-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "cinder-f9f0097e-8b72-4959-878c-0568397406e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Acquiring lock "cinder-quobyte-f9f0097e-8b72-4959-878c-0568397406e7" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "cinder-quobyte-f9f0097e-8b72-4959-878c-0568397406e7" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d019036c-d9c0-472b-a28a-a84e74c38aaf]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:34 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 Sep 09 17:57:34 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:35 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7" returned: 0 in 0.477s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:35 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7 Sep 09 17:57:35 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:35 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f9f0097e-8b72-4959-878c-0568397406e7" returned: 0 in 0.267s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "cinder-quobyte-f9f0097e-8b72-4959-878c-0568397406e7" released by "delete_volume" :: held 0.801s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Created reservations ['b0c24e8b-f0a9-4cd5-a06a-9eab5aa60842', '82e35486-21ee-4445-9da8-a1f3d2f4f9fc', 'afb447b7-fa1b-4854-a50d-e9799bb345d9', '0b9712a7-d300-418a-9063-e5b3717438ec'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:35 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:35 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:35 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.319s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:36 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Deleted volume successfully. Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f69b31c6-2140-427c-8c93-f029ea9353da tempest-VolumeQuotasNegativeTestJSON-1506262186 None] Lock "cinder-f9f0097e-8b72-4959-878c-0568397406e7-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (8cac92ec-cfee-4af9-9ee0-1be35b691d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4b44e7-bb33-4b67-8dfa-f2ad7f6679db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4b44e7-bb33-4b67-8dfa-f2ad7f6679db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-946088882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c78bd78-b4cf-4827-b93f-3ba6be9c59e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:37Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04570ef-e2c5-495d-8d23-56822e9cab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04570ef-e2c5-495d-8d23-56822e9cab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d96480d-4162-43bb-a9fe-149cd82ac188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d96480d-4162-43bb-a9fe-149cd82ac188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c78bd78-b4cf-4827-b93f-3ba6be9c59e6', 'volume_name': 'volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427f418c-2b41-4a62-849f-5062e9daebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427f418c-2b41-4a62-849f-5062e9daebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77440d6-40d3-4ef3-b8dd-c2b2c83985aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:36 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Volume 1c78bd78-b4cf-4827-b93f-3ba6be9c59e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6', 'volume_size': 1} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-946088882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c78bd78-b4cf-4827-b93f-3ba6be9c59e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:37Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Creating volume 1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:36 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:36 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 1073741824 Sep 09 17:57:36 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:37 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 1073741824" returned: 0 in 0.552s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:37 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 Sep 09 17:57:37 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:37 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" returned: 0 in 0.300s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77440d6-40d3-4ef3-b8dd-c2b2c83985aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c27f8d2-6a33-42e6-be80-130c62435fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Volume volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 (1c78bd78-b4cf-4827-b93f-3ba6be9c59e6): created successfully Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c27f8d2-6a33-42e6-be80-130c62435fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (8cac92ec-cfee-4af9-9ee0-1be35b691d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8339e652-f980-4933-879c-16cb28ed9b5b tempest-VolumesActionsTest-214865779 None] Created volume successfully. Sep 09 17:57:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f1e8cb2d-d84f-477a-bd58-17f9d1d361a9 tempest-VolumesActionsTest-214865779 None] Acquiring lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" by "attach_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f1e8cb2d-d84f-477a-bd58-17f9d1d361a9 tempest-VolumesActionsTest-214865779 None] Lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" acquired by "attach_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f1e8cb2d-d84f-477a-bd58-17f9d1d361a9 tempest-VolumesActionsTest-214865779 None] Attaching volume 1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 to instance 05998dc4-123d-4334-848a-d324c0641407 at mountpoint /dev/vdb on host None. Sep 09 17:57:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f1e8cb2d-d84f-477a-bd58-17f9d1d361a9 tempest-VolumesActionsTest-214865779 None] Attach volume completed successfully. Sep 09 17:57:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f1e8cb2d-d84f-477a-bd58-17f9d1d361a9 tempest-VolumesActionsTest-214865779 None] Lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" released by "attach_volume" :: held 0.152s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:39 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ff3f1848-308b-472f-b9fd-2026d0a4afd3 tempest-VolumesActionsTest-1019339990 None] Terminate volume connection completed successfully. Sep 09 17:57:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ff3f1848-308b-472f-b9fd-2026d0a4afd3 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-detach_volume" by "detach_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ff3f1848-308b-472f-b9fd-2026d0a4afd3 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:39 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ff3f1848-308b-472f-b9fd-2026d0a4afd3 tempest-VolumesActionsTest-1019339990 None] Detaching volume 1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 from instance 05998dc4-123d-4334-848a-d324c0641407. Sep 09 17:57:40 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ff3f1848-308b-472f-b9fd-2026d0a4afd3 tempest-VolumesActionsTest-1019339990 None] Detach volume completed successfully. Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ff3f1848-308b-472f-b9fd-2026d0a4afd3 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b817c965-e295-46ac-8ff7-84035e95eec2 tempest-VolumesActionsTest-214865779 None] Acquiring lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-detach_volume" by "detach_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b817c965-e295-46ac-8ff7-84035e95eec2 tempest-VolumesActionsTest-214865779 None] Lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:40 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b817c965-e295-46ac-8ff7-84035e95eec2 tempest-VolumesActionsTest-214865779 None] Volume detach called, but volume not attached. Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b817c965-e295-46ac-8ff7-84035e95eec2 tempest-VolumesActionsTest-214865779 None] Lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Acquiring lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Acquiring lock "cinder-quobyte-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Lock "cinder-quobyte-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bc2ace-9a2a-40d5-ae98-92a8a83aada9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:40 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 Sep 09 17:57:40 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:41 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" returned: 0 in 0.472s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:41 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6 Sep 09 17:57:41 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:41 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" returned: 0 in 0.357s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Lock "cinder-quobyte-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6" released by "delete_volume" :: held 0.902s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Created reservations ['f567ee7b-7465-45f9-8c40-b28f3ec301ff', '3199afff-cbab-4b21-8ccb-66d584efc6bf', '14a4c788-ad05-44c6-9213-f446b27a3c03', '30b9fd61-df84-4a4e-b819-4cfa4564cc51'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:41 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:41 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:42 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.437s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:42 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Deleted volume successfully. Sep 09 17:57:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-283c895e-484f-41f8-a34f-6bba2b95980f tempest-VolumesActionsTest-214865779 None] Lock "cinder-1c78bd78-b4cf-4827-b93f-3ba6be9c59e6-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (c8f0533f-d40a-4958-82a8-33240ad12a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f6c3cd-2880-4659-880b-74a6d575c0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f6c3cd-2880-4659-880b-74a6d575c0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105971994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a4d934-229b-4a38-bc0b-f157ef9a2a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:45Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecfba7e-2bd9-4594-82e2-bf156dc66735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecfba7e-2bd9-4594-82e2-bf156dc66735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8061ff-3229-491c-9355-cf3da97748bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8061ff-3229-491c-9355-cf3da97748bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a4d934-229b-4a38-bc0b-f157ef9a2a58', 'volume_name': 'volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a9034a-2fd9-4d1c-b693-37731b1f51d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a9034a-2fd9-4d1c-b693-37731b1f51d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452f25be-fbbc-4e77-9fd4-2631e6be7712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume b9a4d934-229b-4a38-bc0b-f157ef9a2a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58', 'volume_size': 1} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105971994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a4d934-229b-4a38-bc0b-f157ef9a2a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:45Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Creating volume b9a4d934-229b-4a38-bc0b-f157ef9a2a58 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:45 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:45 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 1073741824 Sep 09 17:57:45 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (2143a7a1-9707-4514-92a9-6ad4e1bec857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15eb332-3052-476a-8807-399ca30ea58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15eb332-3052-476a-8807-399ca30ea58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-610871763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63a5f12-aa14-400c-9ab6-ce07f0a98917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:45Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17a7af9-31ca-494d-8423-9c8933bf3c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17a7af9-31ca-494d-8423-9c8933bf3c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1d80c9-037b-404f-a6f2-4b4341cea00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d1d80c9-037b-404f-a6f2-4b4341cea00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63a5f12-aa14-400c-9ab6-ce07f0a98917', 'volume_name': 'volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff3ac8d-e375-4e58-9a83-ee3e48532406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff3ac8d-e375-4e58-9a83-ee3e48532406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fd62fe-c57e-42fb-b828-7ca302225830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:45 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Volume b63a5f12-aa14-400c-9ab6-ce07f0a98917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917', 'volume_size': 1} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:45 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 1073741824" returned: 0 in 0.528s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:45 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 Sep 09 17:57:45 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:45 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58" returned: 0 in 0.270s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-610871763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63a5f12-aa14-400c-9ab6-ce07f0a98917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:45Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Creating volume b63a5f12-aa14-400c-9ab6-ce07f0a98917 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:45 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452f25be-fbbc-4e77-9fd4-2631e6be7712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:45 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 1073741824 Sep 09 17:57:45 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5a903c-5562-42d6-afe9-c28890017a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 (b9a4d934-229b-4a38-bc0b-f157ef9a2a58): created successfully Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5a903c-5562-42d6-afe9-c28890017a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (c8f0533f-d40a-4958-82a8-33240ad12a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6bfcdad4-5b9f-48c5-853c-841380fd8237 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created volume successfully. Sep 09 17:57:46 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 1073741824" returned: 0 in 0.467s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:46 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 Sep 09 17:57:46 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:46 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917" returned: 0 in 0.298s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9fd62fe-c57e-42fb-b828-7ca302225830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfdc270-bb53-4d60-857d-076637325e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Volume volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 (b63a5f12-aa14-400c-9ab6-ce07f0a98917): created successfully Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfdc270-bb53-4d60-857d-076637325e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (2143a7a1-9707-4514-92a9-6ad4e1bec857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:46 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=95,cinder:UPDATE=121,cinder:DELETE=14,cinder:INSERT=26 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:57:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-48df8fa0-089c-494e-8a53-052d68904b34 tempest-VolumesActionsTest-214865779 None] Created volume successfully. Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (e62c5047-e702-4fb4-b99f-7f8accd3721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae6a283-5d15-4f7f-a541-9255e5e734ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae6a283-5d15-4f7f-a541-9255e5e734ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1763514240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21093b82-2960-4f72-97a0-1425892bd902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:48Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa82dd7f-27e8-4fc0-8354-11d3aa8095e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa82dd7f-27e8-4fc0-8354-11d3aa8095e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fdee0c-ac73-47a3-bb18-2b45dfc66a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2fdee0c-ac73-47a3-bb18-2b45dfc66a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21093b82-2960-4f72-97a0-1425892bd902', 'volume_name': 'volume-21093b82-2960-4f72-97a0-1425892bd902', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7de23da-a3b5-4572-b34f-072d2059767d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7de23da-a3b5-4572-b34f-072d2059767d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92772daf-1617-4ea9-a98a-c5e3016f0c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:47 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume 21093b82-2960-4f72-97a0-1425892bd902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21093b82-2960-4f72-97a0-1425892bd902', 'volume_size': 1} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1763514240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21093b82-2960-4f72-97a0-1425892bd902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:48Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Creating volume 21093b82-2960-4f72-97a0-1425892bd902 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:47 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:47 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 1073741824 Sep 09 17:57:47 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-b63a5f12-aa14-400c-9ab6-ce07f0a98917-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Lock "cinder-b63a5f12-aa14-400c-9ab6-ce07f0a98917-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-quobyte-b63a5f12-aa14-400c-9ab6-ce07f0a98917" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Lock "cinder-quobyte-b63a5f12-aa14-400c-9ab6-ce07f0a98917" acquired by "delete_volume" :: waited 0.025s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d82b93-7316-4f8f-93bd-a0e758f651c9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (106da5ef-0e57-4ce5-8d84-3a32444be0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8467e67e-65a3-4540-8f04-493e72f4ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8467e67e-65a3-4540-8f04-493e72f4ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-448160904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c14b68a-6461-4250-9655-5bb16fd568aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:48Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5d8ec6-058c-4867-8761-5a1277c0ed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5d8ec6-058c-4867-8761-5a1277c0ed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36a8a74-66ff-411d-aeb9-e874f4717df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36a8a74-66ff-411d-aeb9-e874f4717df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c14b68a-6461-4250-9655-5bb16fd568aa', 'volume_name': 'volume-8c14b68a-6461-4250-9655-5bb16fd568aa', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 Sep 09 17:57:48 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a2c440-19ab-4da5-aaf6-e94de073dc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a2c440-19ab-4da5-aaf6-e94de073dc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2deb88-fb8b-43b0-aabb-56f92c798bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume 8c14b68a-6461-4250-9655-5bb16fd568aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c14b68a-6461-4250-9655-5bb16fd568aa', 'volume_size': 1} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:48 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 1073741824" returned: 0 in 0.623s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:48 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 Sep 09 17:57:48 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (2d100c55-afef-46f7-9643-8a6309d75c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:48 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3473943f-2233-492e-9b7d-84c3c1649867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917" returned: 0 in 0.688s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902" returned: 0 in 0.360s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-448160904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c14b68a-6461-4250-9655-5bb16fd568aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:48Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Creating volume 8c14b68a-6461-4250-9655-5bb16fd568aa {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:48 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:48 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917 Sep 09 17:57:48 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3473943f-2233-492e-9b7d-84c3c1649867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-695909488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d243668a-9cf3-4494-b386-056bde40646e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:49Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa 1073741824 Sep 09 17:57:48 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a979709-1cfe-4e6f-a1a0-2fa8a1441c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a979709-1cfe-4e6f-a1a0-2fa8a1441c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be481256-9e48-4191-b2fa-4066e2229951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be481256-9e48-4191-b2fa-4066e2229951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd243668a-9cf3-4494-b386-056bde40646e', 'volume_name': 'volume-d243668a-9cf3-4494-b386-056bde40646e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eb3d62-bb74-4476-8428-84c98e8b2b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eb3d62-bb74-4476-8428-84c98e8b2b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78cdeec-73f1-4b61-a6cf-385ac820d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:48 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume d243668a-9cf3-4494-b386-056bde40646e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d243668a-9cf3-4494-b386-056bde40646e', 'volume_size': 1} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92772daf-1617-4ea9-a98a-c5e3016f0c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21093b82-2960-4f72-97a0-1425892bd902', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:48 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd2009b-e1df-4d5d-81f9-3dbbcc0c2f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume volume-21093b82-2960-4f72-97a0-1425892bd902 (21093b82-2960-4f72-97a0-1425892bd902): created successfully Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd2009b-e1df-4d5d-81f9-3dbbcc0c2f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (e62c5047-e702-4fb4-b99f-7f8accd3721a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:49 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6ec9ebb1-95f5-4fce-95f5-3c73f0e306c2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created volume successfully. Sep 09 17:57:49 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b63a5f12-aa14-400c-9ab6-ce07f0a98917" returned: 0 in 0.461s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (10881c1e-ec67-4034-890b-612f7db7d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab36f892-2523-4c5c-95e5-e73237df0106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Lock "cinder-quobyte-b63a5f12-aa14-400c-9ab6-ce07f0a98917" released by "delete_volume" :: held 1.270s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab36f892-2523-4c5c-95e5-e73237df0106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-16853983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57456ad3-2adf-48d0-a34f-2180daf3c1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:49Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f5752c-5889-4c3b-8bbe-db84615e28da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f5752c-5889-4c3b-8bbe-db84615e28da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6035d05-bf72-417b-8743-9abae88250f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6035d05-bf72-417b-8743-9abae88250f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57456ad3-2adf-48d0-a34f-2180daf3c1da', 'volume_name': 'volume-57456ad3-2adf-48d0-a34f-2180daf3c1da', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78b7a8d-3c09-455b-ae70-784d93cc648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78b7a8d-3c09-455b-ae70-784d93cc648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6bf2ae-74f5-4dba-8e85-a2e836586419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume 57456ad3-2adf-48d0-a34f-2180daf3c1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57456ad3-2adf-48d0-a34f-2180daf3c1da', 'volume_size': 1} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Created reservations ['c52ec658-d36a-4e26-b5ae-5d3a6047df42', 'ae9224d9-5ffa-41c2-a72e-57e358344c07', 'b81c0c29-1fc3-4fcb-aad1-3d9ba44885b1', '39c31823-22d5-48fd-a32a-3699b8d055ab'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:49 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:49 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:49 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa 1073741824" returned: 0 in 0.852s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:49 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa Sep 09 17:57:49 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (d03e1f9e-716a-4946-b5e7-44cecae80016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f1072e-9806-457a-9825-78802202ea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f1072e-9806-457a-9825-78802202ea80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844500645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53f0303-a31a-43fc-9086-50b64ca07e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:50Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfbec21-053a-4676-a02a-47a6c78246ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfbec21-053a-4676-a02a-47a6c78246ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d9fc68-d612-4ec4-8c0d-9131023a6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d9fc68-d612-4ec4-8c0d-9131023a6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53f0303-a31a-43fc-9086-50b64ca07e98', 'volume_name': 'volume-e53f0303-a31a-43fc-9086-50b64ca07e98', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c122e181-6a38-4c70-a4c3-8df97e628dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c122e181-6a38-4c70-a4c3-8df97e628dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636d7f99-33f0-41f3-9ff7-45e8257c4575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:49 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume e53f0303-a31a-43fc-9086-50b64ca07e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53f0303-a31a-43fc-9086-50b64ca07e98', 'volume_size': 1} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:49 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.348s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:49 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Deleted volume successfully. Sep 09 17:57:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f12e6923-7d0d-4b5c-910f-4369b728744f tempest-VolumesActionsTest-1019339990 None] Lock "cinder-b63a5f12-aa14-400c-9ab6-ce07f0a98917-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:50 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa" returned: 0 in 0.338s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.141s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-695909488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d243668a-9cf3-4494-b386-056bde40646e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:49Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Creating volume d243668a-9cf3-4494-b386-056bde40646e {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:50 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2deb88-fb8b-43b0-aabb-56f92c798bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c14b68a-6461-4250-9655-5bb16fd568aa', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:50 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e 1073741824 Sep 09 17:57:50 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d29bfec-fbda-44b6-abde-aaa91a0a5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:50 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume volume-8c14b68a-6461-4250-9655-5bb16fd568aa (8c14b68a-6461-4250-9655-5bb16fd568aa): created successfully Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d29bfec-fbda-44b6-abde-aaa91a0a5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (106da5ef-0e57-4ce5-8d84-3a32444be0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:50 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-27d1e676-2526-4dba-a973-1da7c09468bf tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created volume successfully. Sep 09 17:57:50 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e 1073741824" returned: 0 in 0.545s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:50 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e Sep 09 17:57:50 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (cc7143eb-4249-464a-a123-6e9076f9f634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6045113-702a-491b-a8ad-258f560051ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6045113-702a-491b-a8ad-258f560051ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766657295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b17cf8-4907-4338-bb74-54104a3b3a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:51Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5876eb-bd37-4adc-aa4f-e245f3d34a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5876eb-bd37-4adc-aa4f-e245f3d34a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cd6ebb-1338-45cb-a632-5293ec0a6750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cd6ebb-1338-45cb-a632-5293ec0a6750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b17cf8-4907-4338-bb74-54104a3b3a5b', 'volume_name': 'volume-89b17cf8-4907-4338-bb74-54104a3b3a5b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ca6121-0d54-4d16-bee5-5a84f1be2e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ca6121-0d54-4d16-bee5-5a84f1be2e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee22769-192a-4bf7-9eb2-b9665f503bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:50 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Volume 89b17cf8-4907-4338-bb74-54104a3b3a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b17cf8-4907-4338-bb74-54104a3b3a5b', 'volume_size': 1} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:50 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-16853983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57456ad3-2adf-48d0-a34f-2180daf3c1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:49Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Creating volume 57456ad3-2adf-48d0-a34f-2180daf3c1da {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:50 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78cdeec-73f1-4b61-a6cf-385ac820d39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d243668a-9cf3-4494-b386-056bde40646e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:51 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da 1073741824 Sep 09 17:57:51 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e0a8a2-7ccb-471d-b99f-db8d83b76183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:51 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume volume-d243668a-9cf3-4494-b386-056bde40646e (d243668a-9cf3-4494-b386-056bde40646e): created successfully Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e0a8a2-7ccb-471d-b99f-db8d83b76183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (2d100c55-afef-46f7-9643-8a6309d75c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5cba1a31-eba3-421f-a21a-827dfe855686 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created volume successfully. Sep 09 17:57:51 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da 1073741824" returned: 0 in 0.465s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:51 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da Sep 09 17:57:51 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:51 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1844500645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53f0303-a31a-43fc-9086-50b64ca07e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c25c32a21647c0b8af720cb20f38a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:50Z,use_quota=True,user_id='54cbccff123e4d25a733c0bdde6ada19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Creating volume e53f0303-a31a-43fc-9086-50b64ca07e98 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:51 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:51 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 1073741824 Sep 09 17:57:51 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6bf2ae-74f5-4dba-8e85-a2e836586419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57456ad3-2adf-48d0-a34f-2180daf3c1da', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148daf7d-3b73-4121-b257-6afec626747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:51 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume volume-57456ad3-2adf-48d0-a34f-2180daf3c1da (57456ad3-2adf-48d0-a34f-2180daf3c1da): created successfully Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148daf7d-3b73-4121-b257-6afec626747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (10881c1e-ec67-4034-890b-612f7db7d87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-21c938a9-4402-4053-bfd0-2a09d68c4ce4 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created volume successfully. Sep 09 17:57:52 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 1073741824" returned: 0 in 0.499s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:52 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 Sep 09 17:57:52 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:52 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766657295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b17cf8-4907-4338-bb74-54104a3b3a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:51Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Creating volume 89b17cf8-4907-4338-bb74-54104a3b3a5b {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:52 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:52 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b 1073741824 Sep 09 17:57:52 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636d7f99-33f0-41f3-9ff7-45e8257c4575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53f0303-a31a-43fc-9086-50b64ca07e98', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c989fd7b-f097-4706-abdd-7996ff24b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:52 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Volume volume-e53f0303-a31a-43fc-9086-50b64ca07e98 (e53f0303-a31a-43fc-9086-50b64ca07e98): created successfully Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c989fd7b-f097-4706-abdd-7996ff24b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Flow 'volume_create_manager' (d03e1f9e-716a-4946-b5e7-44cecae80016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c02f7531-7017-4b4f-b91e-0762e6c8b859 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created volume successfully. Sep 09 17:57:53 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b 1073741824" returned: 0 in 0.459s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:53 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b Sep 09 17:57:53 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-e53f0303-a31a-43fc-9086-50b64ca07e98-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-e53f0303-a31a-43fc-9086-50b64ca07e98-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-quobyte-e53f0303-a31a-43fc-9086-50b64ca07e98" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:53 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b" returned: 0 in 0.282s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee22769-192a-4bf7-9eb2-b9665f503bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b17cf8-4907-4338-bb74-54104a3b3a5b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245c6ebb-62a7-4afd-8c9c-4a01ee5bd414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-e53f0303-a31a-43fc-9086-50b64ca07e98" acquired by "delete_volume" :: waited 0.043s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Volume volume-89b17cf8-4907-4338-bb74-54104a3b3a5b (89b17cf8-4907-4338-bb74-54104a3b3a5b): created successfully Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245c6ebb-62a7-4afd-8c9c-4a01ee5bd414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (cc7143eb-4249-464a-a123-6e9076f9f634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[590d26c0-d951-43de-adc9-a75bc7e8d9cb]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-32f329fa-1154-4bf5-9fe7-a4322e2969de tempest-VolumesActionsTest-214865779 None] Created volume successfully. Sep 09 17:57:53 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 Sep 09 17:57:53 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:53 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98" returned: 0 in 0.390s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:53 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98 Sep 09 17:57:53 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:54 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e53f0303-a31a-43fc-9086-50b64ca07e98" returned: 0 in 0.293s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-e53f0303-a31a-43fc-9086-50b64ca07e98" released by "delete_volume" :: held 0.746s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-89b17cf8-4907-4338-bb74-54104a3b3a5b-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-89b17cf8-4907-4338-bb74-54104a3b3a5b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created reservations ['4e28457b-46f1-476d-9df3-94292132f0c4', 'adc34250-efaa-40e1-851a-d4ce68c63afa', '666d04bc-46fb-4bab-a908-44036bcb9511', '43e55b4f-c045-4cdf-a3d7-492a66051bd9'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-quobyte-89b17cf8-4907-4338-bb74-54104a3b3a5b" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-quobyte-89b17cf8-4907-4338-bb74-54104a3b3a5b" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a719eca0-5cec-400f-a78b-5bc9bd357dba]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:54 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:54 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:54 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b Sep 09 17:57:54 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-57456ad3-2adf-48d0-a34f-2180daf3c1da-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-57456ad3-2adf-48d0-a34f-2180daf3c1da-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-quobyte-57456ad3-2adf-48d0-a34f-2180daf3c1da" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-57456ad3-2adf-48d0-a34f-2180daf3c1da" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1a54b6-b62d-4c72-9c7e-f2f649f6eac7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:54 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b" returned: 0 in 0.439s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:54 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.411s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:54 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b Sep 09 17:57:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Deleted volume successfully. Sep 09 17:57:54 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:54 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da Sep 09 17:57:54 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64769065-daa6-4453-8fe0-dbb653c79810 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-e53f0303-a31a-43fc-9086-50b64ca07e98-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:55 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-89b17cf8-4907-4338-bb74-54104a3b3a5b" returned: 0 in 0.315s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-quobyte-89b17cf8-4907-4338-bb74-54104a3b3a5b" released by "delete_volume" :: held 0.797s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Created reservations ['a031383c-618d-4d3c-8ade-c0120728166e', 'c76f7f08-eafc-43fd-877a-1265c76efc33', '60666430-a130-4996-a42f-9d167c86cacf', 'a3bc7218-a207-4656-9492-e0125072151a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:55 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da" returned: 0 in 0.488s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:55 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da Sep 09 17:57:55 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:55 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:55 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:55 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-57456ad3-2adf-48d0-a34f-2180daf3c1da" returned: 0 in 0.282s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-57456ad3-2adf-48d0-a34f-2180daf3c1da" released by "delete_volume" :: held 0.823s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created reservations ['efd7731c-5a34-4b82-a2d3-1a6af21ba1c9', '4143ae52-a130-499f-b591-a6b75df0eae3', '41667789-5c69-4196-9494-a8df1f5877b8', 'a6afd883-2803-45c2-a6d2-15d0052501a9'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:55 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.308s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Deleted volume successfully. Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-edbf6abf-67bf-472e-a8a2-6e264d37f149 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-89b17cf8-4907-4338-bb74-54104a3b3a5b-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:55 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:55 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-d243668a-9cf3-4494-b386-056bde40646e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-d243668a-9cf3-4494-b386-056bde40646e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-quobyte-d243668a-9cf3-4494-b386-056bde40646e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-d243668a-9cf3-4494-b386-056bde40646e" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3c730d-eb0a-4d89-a109-9218e737bfbd]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:55 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.348s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:55 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Deleted volume successfully. Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0dfab0b-d1d7-4444-81a9-821f884bc076 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-57456ad3-2adf-48d0-a34f-2180daf3c1da-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (5562f7d2-6746-4900-b292-2f93cc64de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:56 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e Sep 09 17:57:56 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70c93ec-c483-4917-ab52-1ec7a6e7d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70c93ec-c483-4917-ab52-1ec7a6e7d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-320756302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a980477-dd79-4cd7-9303-50796f063e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:56Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c5e02d-f7d9-48e0-a84e-f3381c32cebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c5e02d-f7d9-48e0-a84e-f3381c32cebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1872cd-4bd7-4773-90db-8749840f5666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1872cd-4bd7-4773-90db-8749840f5666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a980477-dd79-4cd7-9303-50796f063e11', 'volume_name': 'volume-3a980477-dd79-4cd7-9303-50796f063e11', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458892e5-136e-49e2-84a3-9af791b028d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458892e5-136e-49e2-84a3-9af791b028d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27efc4b-9312-40c9-bf8f-cf8c45e035d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Volume 3a980477-dd79-4cd7-9303-50796f063e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a980477-dd79-4cd7-9303-50796f063e11', 'volume_size': 1} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-320756302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a980477-dd79-4cd7-9303-50796f063e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:57:56Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Creating volume 3a980477-dd79-4cd7-9303-50796f063e11 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:57:56 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:56 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 1073741824 Sep 09 17:57:56 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:56 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e" returned: 0 in 0.405s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:56 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e Sep 09 17:57:56 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:56 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d243668a-9cf3-4494-b386-056bde40646e" returned: 0 in 0.256s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-d243668a-9cf3-4494-b386-056bde40646e" released by "delete_volume" :: held 0.728s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created reservations ['a15a5533-ff21-4bbb-b583-a9b23e348c13', '8ed7cadc-9770-4a17-bd44-4f5f34de35a7', 'fa4f8e5b-de0f-45b1-85c1-63b7ecfce9b7', 'c44747f9-9a6d-4d44-b5d5-c2117311f48e'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:56 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 1073741824" returned: 0 in 0.561s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:56 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 Sep 09 17:57:56 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:56 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:56 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:57 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-8c14b68a-6461-4250-9655-5bb16fd568aa-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11" returned: 0 in 0.269s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27efc4b-9312-40c9-bf8f-cf8c45e035d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a980477-dd79-4cd7-9303-50796f063e11', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aaaf70d-922f-4fa8-a791-36b0ebcf13e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-8c14b68a-6461-4250-9655-5bb16fd568aa-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:57 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Volume volume-3a980477-dd79-4cd7-9303-50796f063e11 (3a980477-dd79-4cd7-9303-50796f063e11): created successfully Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aaaf70d-922f-4fa8-a791-36b0ebcf13e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (5562f7d2-6746-4900-b292-2f93cc64de0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:57:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b3f0262e-fc18-4a50-a74b-b168879680b3 tempest-VolumesActionsTest-214865779 None] Created volume successfully. Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-quobyte-8c14b68a-6461-4250-9655-5bb16fd568aa" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:57 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-8c14b68a-6461-4250-9655-5bb16fd568aa" acquired by "delete_volume" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.351s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Deleted volume successfully. Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d067f41c-0eff-4859-9de9-d90f95fa4576]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6d27df23-eb39-4ffb-a447-48a2b842696b tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-d243668a-9cf3-4494-b386-056bde40646e-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:57 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa Sep 09 17:57:57 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:57 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa" returned: 0 in 0.422s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:57 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa Sep 09 17:57:57 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:57 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8c14b68a-6461-4250-9655-5bb16fd568aa" returned: 0 in 0.253s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-8c14b68a-6461-4250-9655-5bb16fd568aa" released by "delete_volume" :: held 0.725s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:57 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created reservations ['0ffad44a-4f23-4f58-ac9f-1183aec3c54f', '55340309-b0e1-4936-b202-c0f42a06844e', '0fc20e02-1ae2-43b3-a611-d5d6b26e54e1', '0d11c23b-f78a-4ea0-882e-41bb5572d29f'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:58 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:58 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-21093b82-2960-4f72-97a0-1425892bd902-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-3a980477-dd79-4cd7-9303-50796f063e11-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-21093b82-2960-4f72-97a0-1425892bd902-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-3a980477-dd79-4cd7-9303-50796f063e11-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:58 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.325s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Deleted volume successfully. Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-quobyte-3a980477-dd79-4cd7-9303-50796f063e11" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-quobyte-21093b82-2960-4f72-97a0-1425892bd902" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ae1218ab-d917-4f4d-917d-6700342f6852 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-8c14b68a-6461-4250-9655-5bb16fd568aa-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-quobyte-3a980477-dd79-4cd7-9303-50796f063e11" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-21093b82-2960-4f72-97a0-1425892bd902" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b0bdfc-d24f-41ad-bed0-b7ae9dc5a2a9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a041f833-146f-4b3d-bdff-dad9a63328ab]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:58 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 Sep 09 17:57:58 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:58 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 Sep 09 17:57:58 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:58 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11" returned: 0 in 0.379s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:58 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:58 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11 Sep 09 17:57:58 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:58 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902 Sep 09 17:57:58 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:59 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a980477-dd79-4cd7-9303-50796f063e11" returned: 0 in 0.263s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:59 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-21093b82-2960-4f72-97a0-1425892bd902" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-quobyte-3a980477-dd79-4cd7-9303-50796f063e11" released by "delete_volume" :: held 0.687s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-21093b82-2960-4f72-97a0-1425892bd902" released by "delete_volume" :: held 0.683s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created reservations ['04103799-40db-4f89-b28d-fb425edfc747', '0f513f4a-18b0-4053-8ff1-8bcdb9d11425', '0f5d6382-38f0-4a5d-ba01-4cd1841b3e85', 'f651c68a-1670-410a-9716-9900c62ad904'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Created reservations ['2923518e-186e-4fe1-8beb-4dad078b804f', '57c7a600-84df-4cce-a870-c2ff4a9c233c', 'f5f7b15a-0ab8-4cac-a840-fc1dabb8a252', 'c6a67067-c5f5-4b29-a8d6-d66f81a7d6f4'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:59 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:59 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:59 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:57:59 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-b9a4d934-229b-4a38-bc0b-f157ef9a2a58-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-b9a4d934-229b-4a38-bc0b-f157ef9a2a58-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "cinder-quobyte-b9a4d934-229b-4a38-bc0b-f157ef9a2a58" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-b9a4d934-229b-4a38-bc0b-f157ef9a2a58" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:57:59 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.366s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Deleted volume successfully. Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6508dd18-40f5-42c5-af79-8672a62827f2 tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-21093b82-2960-4f72-97a0-1425892bd902-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[836df5d2-2f94-4dc9-9c61-e4832c796bfb]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:57:59 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.416s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:57:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Deleted volume successfully. Sep 09 17:57:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c175ee00-c40d-4ece-9131-e338a760fb32 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-3a980477-dd79-4cd7-9303-50796f063e11-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:57:59 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 Sep 09 17:57:59 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:00 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58" returned: 0 in 0.540s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:00 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58 Sep 09 17:58:00 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (8fef3be4-3e98-4175-9316-564ffc155716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e327a8-782c-4a32-8798-41d66dfc24c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e327a8-782c-4a32-8798-41d66dfc24c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-792031307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e702c6d5-7fa0-4a8d-8836-393738557dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:00Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fc4108-421e-42ca-8fe8-cac93b83c95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2fc4108-421e-42ca-8fe8-cac93b83c95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3086d061-6418-4a3a-890f-64a96868a35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3086d061-6418-4a3a-890f-64a96868a35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e702c6d5-7fa0-4a8d-8836-393738557dc4', 'volume_name': 'volume-e702c6d5-7fa0-4a8d-8836-393738557dc4', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f03846-87f3-4330-b92e-9bf4bbb0474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f03846-87f3-4330-b92e-9bf4bbb0474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9a2404-d226-4058-86d2-0109de769be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Volume e702c6d5-7fa0-4a8d-8836-393738557dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e702c6d5-7fa0-4a8d-8836-393738557dc4', 'volume_size': 1} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-792031307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e702c6d5-7fa0-4a8d-8836-393738557dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:00Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Creating volume e702c6d5-7fa0-4a8d-8836-393738557dc4 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:00 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:00 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 1073741824 Sep 09 17:58:00 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:00 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b9a4d934-229b-4a38-bc0b-f157ef9a2a58" returned: 0 in 0.316s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-quobyte-b9a4d934-229b-4a38-bc0b-f157ef9a2a58" released by "delete_volume" :: held 0.931s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Created reservations ['c726a5f9-d386-4886-bb5d-d7f9283883ca', 'aed006bb-c0a4-4b0f-82a6-00d029ff1b16', '1f85eddd-032a-4840-b0b0-65cd091411ff', '8df288b0-90e2-4969-8cb1-5d5faa8dfb7c'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:00 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:00 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:00 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 1073741824" returned: 0 in 0.498s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:00 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 Sep 09 17:58:00 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:00 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.266s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Deleted volume successfully. Sep 09 17:58:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-61bc3043-e98d-4091-83b3-d1674f81b1fc tempest-CreateVolumesFromSourceVolumeTest-926737734 None] Lock "cinder-b9a4d934-229b-4a38-bc0b-f157ef9a2a58-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:01 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4" returned: 0 in 0.265s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9a2404-d226-4058-86d2-0109de769be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e702c6d5-7fa0-4a8d-8836-393738557dc4', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b747072-526d-4b96-a381-e448ebcad344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:01 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Volume volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 (e702c6d5-7fa0-4a8d-8836-393738557dc4): created successfully Sep 09 17:58:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b747072-526d-4b96-a381-e448ebcad344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (8fef3be4-3e98-4175-9316-564ffc155716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7ce06fce-f786-4940-aba0-bdbe8d955fc4 tempest-VolumesActionsTest-214865779 None] Created volume successfully. Sep 09 17:58:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-e702c6d5-7fa0-4a8d-8836-393738557dc4-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-e702c6d5-7fa0-4a8d-8836-393738557dc4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "cinder-quobyte-e702c6d5-7fa0-4a8d-8836-393738557dc4" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-quobyte-e702c6d5-7fa0-4a8d-8836-393738557dc4" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0e038-349c-465f-a150-f0e3fe8257be]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:02 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 Sep 09 17:58:02 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:03 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4" returned: 0 in 0.476s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:03 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4 Sep 09 17:58:03 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:03 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e702c6d5-7fa0-4a8d-8836-393738557dc4" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-quobyte-e702c6d5-7fa0-4a8d-8836-393738557dc4" released by "delete_volume" :: held 0.803s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Created reservations ['68452ea2-7be6-485b-9028-d27e0d54455f', '89871c5a-e192-4cfa-91e5-08f6e97c191d', 'f25d6565-9383-4255-ae50-f1cf65f728b8', '4871a317-9cb8-4d2c-b498-74d9696f1afc'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:03 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:03 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:03 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.307s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:03 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Deleted volume successfully. Sep 09 17:58:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bd3b434d-91a6-4d6d-a94f-8bb8837a12a2 tempest-VolumesActionsTest-1019339990 None] Lock "cinder-e702c6d5-7fa0-4a8d-8836-393738557dc4-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (0a09f7c3-f7d2-45b2-82a6-22ddd1bee943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525dd700-2bd4-40ef-99b7-4918d25e2e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (525dd700-2bd4-40ef-99b7-4918d25e2e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-294383608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420ffbcb-f643-464c-8568-90f8b21464aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:04Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1996e2e1-b3b2-4134-96e4-803491230fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1996e2e1-b3b2-4134-96e4-803491230fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0701bb-83f0-48a6-a2f1-c985295d9dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0701bb-83f0-48a6-a2f1-c985295d9dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420ffbcb-f643-464c-8568-90f8b21464aa', 'volume_name': 'volume-420ffbcb-f643-464c-8568-90f8b21464aa', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78f418e-2a3f-4e08-8dbd-a607342ea8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78f418e-2a3f-4e08-8dbd-a607342ea8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138683e0-2988-4b92-9539-7a61ddd00401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:04 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Volume 420ffbcb-f643-464c-8568-90f8b21464aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420ffbcb-f643-464c-8568-90f8b21464aa', 'volume_size': 1} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-294383608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420ffbcb-f643-464c-8568-90f8b21464aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90cf280ef6348f29d3ddcaa258c3524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:04Z,use_quota=True,user_id='f690d9269e0c40859e6702f27cf8cb76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Creating volume 420ffbcb-f643-464c-8568-90f8b21464aa {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:04 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:04 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa 1073741824 Sep 09 17:58:04 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:04 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa 1073741824" returned: 0 in 0.511s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:05 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:05 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:05 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa Sep 09 17:58:05 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:05 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.309s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:58:05 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa" returned: 0 in 0.330s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138683e0-2988-4b92-9539-7a61ddd00401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420ffbcb-f643-464c-8568-90f8b21464aa', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2631fdd8-68cd-4ddc-bd79-7831ec5f4394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:05 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Volume volume-420ffbcb-f643-464c-8568-90f8b21464aa (420ffbcb-f643-464c-8568-90f8b21464aa): created successfully Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2631fdd8-68cd-4ddc-bd79-7831ec5f4394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Flow 'volume_create_manager' (0a09f7c3-f7d2-45b2-82a6-22ddd1bee943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d072a32c-544c-4136-bcd6-61a8cf740a9e tempest-VolumesActionsTest-214865779 None] Created volume successfully. Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Acquiring lock "cinder-420ffbcb-f643-464c-8568-90f8b21464aa-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Lock "cinder-420ffbcb-f643-464c-8568-90f8b21464aa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Acquiring lock "cinder-quobyte-420ffbcb-f643-464c-8568-90f8b21464aa" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Flow 'volume_create_manager' (ce4b7b5d-655d-416c-bfb9-e4582661b042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff88245b-43d2-414c-a9d9-58b2b4dc9437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Lock "cinder-quobyte-420ffbcb-f643-464c-8568-90f8b21464aa" acquired by "delete_volume" :: waited 0.050s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff88245b-43d2-414c-a9d9-58b2b4dc9437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-426198496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df1b21b-e0e9-491a-83af-16e2cc93ac60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dce2b9dea40497090969f7c34031c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:06Z,use_quota=True,user_id='4141bd1606ec403abf35d7ef07c78982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f3b96-0625-4476-95d9-c055d38674f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f3b96-0625-4476-95d9-c055d38674f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb8c271-d304-41b7-ac8a-3a9472f432ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb8c271-d304-41b7-ac8a-3a9472f432ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df1b21b-e0e9-491a-83af-16e2cc93ac60', 'volume_name': 'volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c120b07-d99a-42ff-b436-11ce6bdb46e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c120b07-d99a-42ff-b436-11ce6bdb46e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9427646-96e6-49b4-8fb0-feaa0bb621d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:06 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Volume 8df1b21b-e0e9-491a-83af-16e2cc93ac60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60', 'volume_size': 1} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-426198496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df1b21b-e0e9-491a-83af-16e2cc93ac60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dce2b9dea40497090969f7c34031c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:06Z,use_quota=True,user_id='4141bd1606ec403abf35d7ef07c78982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Creating volume 8df1b21b-e0e9-491a-83af-16e2cc93ac60 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:06 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbce54b3-58dc-4af0-a3c8-60cd83cc4cc3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:06 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 1073741824 Sep 09 17:58:06 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:06 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa Sep 09 17:58:06 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:06 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa" returned: 0 in 0.414s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:06 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa Sep 09 17:58:06 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:06 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 1073741824" returned: 0 in 0.477s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:06 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 Sep 09 17:58:06 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:07 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-420ffbcb-f643-464c-8568-90f8b21464aa" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Lock "cinder-quobyte-420ffbcb-f643-464c-8568-90f8b21464aa" released by "delete_volume" :: held 0.778s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Created reservations ['b8e7fa4f-a1c5-4a2b-aa04-56e95893e158', '0e54d9e9-4922-48ff-93ec-d1e5f540cbd4', '7f901265-b5eb-4571-972e-1b63d7274629', 'e26ed64a-0b7b-4353-b1b3-006a08e2e703'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:07 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60" returned: 0 in 0.292s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9427646-96e6-49b4-8fb0-feaa0bb621d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba253a5-3381-40e8-afab-cd521b499d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:07 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Volume volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 (8df1b21b-e0e9-491a-83af-16e2cc93ac60): created successfully Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba253a5-3381-40e8-afab-cd521b499d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Flow 'volume_create_manager' (ce4b7b5d-655d-416c-bfb9-e4582661b042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:07 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4dba08b2-0736-4b82-a43b-6fc43d2bac33 tempest-AbsoluteLimitsTests-639253560 None] Created volume successfully. Sep 09 17:58:07 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:07 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:07 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.260s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:07 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Deleted volume successfully. Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d4b50165-2739-47ea-9a27-1d94405231a7 tempest-VolumesActionsTest-214865779 None] Lock "cinder-420ffbcb-f643-464c-8568-90f8b21464aa-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:07 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Flow 'volume_create_manager' (97b1771f-e17a-452e-9b69-e5421765a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09448b1c-ec25-47b3-a154-01740c32e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09448b1c-ec25-47b3-a154-01740c32e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77cf8b9-13a7-494e-bcf7-fbdffbd40d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e19b44d45c44859759211886613abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:08Z,use_quota=True,user_id='949d58c7d5ea4090bb78abe0bebdba22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5a2432-b469-47e3-960b-b3e09610b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5a2432-b469-47e3-960b-b3e09610b085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af765b01-f72a-460e-a62a-1684856d3d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af765b01-f72a-460e-a62a-1684856d3d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c77cf8b9-13a7-494e-bcf7-fbdffbd40d45', 'volume_name': 'volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45', 'volume_size': 1, 'image_id': '76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ef79e68ce0d5d388238996ae53a5f37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c0e19b44d45c44859759211886613abb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98d38ae30a1b4c8413fe986521809c89fcc25def35a5b439a884b8b808171abaac3d89991c920a761ede1f7933eae3cc11889ab30d2f6cd8e8bcef2abeda83f5', 'id': '76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'created_at': datetime.datetime(2026, 9, 9, 15, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9/file', 'properties': {}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75fbe11-4e05-4036-af1d-16208b3e79d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d75fbe11-4e05-4036-af1d-16208b3e79d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bef2f1-1917-42e4-bdf1-f9b964218094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:08 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Volume c77cf8b9-13a7-494e-bcf7-fbdffbd40d45: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45', 'volume_size': 1, 'image_id': '76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ef79e68ce0d5d388238996ae53a5f37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c0e19b44d45c44859759211886613abb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98d38ae30a1b4c8413fe986521809c89fcc25def35a5b439a884b8b808171abaac3d89991c920a761ede1f7933eae3cc11889ab30d2f6cd8e8bcef2abeda83f5', 'id': '76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'created_at': datetime.datetime(2026, 9, 9, 15, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9/file', 'properties': {}}, 'image_service': } Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Trying to clone c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 from image 76306f9b-7c71-47c1-9ccf-f2e50c4baaf9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 17:58:08 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Image download 0.00 MB at 0.00 MB/s Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Acquiring lock "cinder-8df1b21b-e0e9-491a-83af-16e2cc93ac60-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Lock "cinder-8df1b21b-e0e9-491a-83af-16e2cc93ac60-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ddbf83-5101-48ee-9b0f-30dc7303776c]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Acquiring lock "cinder-quobyte-8df1b21b-e0e9-491a-83af-16e2cc93ac60" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Lock "cinder-quobyte-8df1b21b-e0e9-491a-83af-16e2cc93ac60" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7523ad06-8458-45d6-91fc-97b1796e414b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:08 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD Sep 09 17:58:08 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:08 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 Sep 09 17:58:08 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:08 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:09 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD Sep 09 17:58:09 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:09 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60" returned: 0 in 0.396s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:09 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60 Sep 09 17:58:09 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:09 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Temporary image 76306f9b-7c71-47c1-9ccf-f2e50c4baaf9 is fetched for user 949d58c7d5ea4090bb78abe0bebdba22. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 17:58:09 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8df1b21b-e0e9-491a-83af-16e2cc93ac60" returned: 0 in 0.256s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Lock "cinder-quobyte-8df1b21b-e0e9-491a-83af-16e2cc93ac60" released by "delete_volume" :: held 0.704s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e71a38-2efb-414b-b939-01f519fad500]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Created reservations ['cfc6f012-0d61-4eda-adca-cb640ee2368a', '22ccecc5-54db-4a90-ac2b-ea2493a172c6', 'c86fa389-b9fa-4bc4-b64a-294f4f8cb3a2', '025ddbb5-4f0f-429a-8ef5-bcf3b337551e'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:09 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD Sep 09 17:58:09 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:09 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:09 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:09 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:09 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.288s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:09 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Deleted volume successfully. Sep 09 17:58:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4537ff3a-22e6-447d-90ee-8b9fbd4e3aff tempest-AbsoluteLimitsTests-639253560 None] Lock "cinder-8df1b21b-e0e9-491a-83af-16e2cc93ac60-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:09 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD Sep 09 17:58:09 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:10 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77cf8b9-13a7-494e-bcf7-fbdffbd40d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e19b44d45c44859759211886613abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:08Z,use_quota=True,user_id='949d58c7d5ea4090bb78abe0bebdba22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Creating volume c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:10 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:10 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 1073741824 Sep 09 17:58:10 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:10 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 1073741824" returned: 0 in 0.543s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:10 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 Sep 09 17:58:10 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:11 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Attempting download of 76306f9b-7c71-47c1-9ccf-f2e50c4baaf9 ((None, [{'url': 'file:///opt/stack/data/glance/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'metadata': {}}])) to volume c77cf8b9-13a7-494e-bcf7-fbdffbd40d45. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc499ba2-a138-475a-ab80-b50c8d35ebdd]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_9ydhhgla {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:11 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_9ydhhgla Sep 09 17:58:11 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:11 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_9ydhhgla" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_9ydhhgla {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:11 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_9ydhhgla Sep 09 17:58:11 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:11 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_9ydhhgla" returned: 1 in 0.481s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_9ydhhgla' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[19263e6d-8661-40e0-8819-f9f7c13fcc92]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:12 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD Sep 09 17:58:12 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:12 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:12 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD Sep 09 17:58:12 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:12 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:58:12 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] 76306f9b-7c71-47c1-9ccf-f2e50c4baaf9 was raw, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 17:58:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:12 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 Sep 09 17:58:12 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:13 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45" returned: 0 in 0.577s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_76306f9b-7c71-47c1-9ccf-f2e50c4baaf9_r44fmyz8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:58:13 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:13 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 1G Sep 09 17:58:13 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:13 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 1G" returned: 0 in 0.360s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Downloaded image 76306f9b-7c71-47c1-9ccf-f2e50c4baaf9 ((None, [{'url': 'file:///opt/stack/data/glance/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'metadata': {}}])) to volume c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Temporary image 76306f9b-7c71-47c1-9ccf-f2e50c4baaf9 for user 949d58c7d5ea4090bb78abe0bebdba22 is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Marking volume c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Copying metadata from image 76306f9b-7c71-47c1-9ccf-f2e50c4baaf9 to c77cf8b9-13a7-494e-bcf7-fbdffbd40d45. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Creating volume glance metadata for volume c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 backed by image 76306f9b-7c71-47c1-9ccf-f2e50c4baaf9 with: {'image_id': '76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4ef79e68ce0d5d388238996ae53a5f37', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=170,cinder:SELECT=126,cinder:INSERT=37,cinder:DELETE=13 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bef2f1-1917-42e4-bdf1-f9b964218094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45', 'volume_size': 1, 'image_id': '76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ef79e68ce0d5d388238996ae53a5f37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c0e19b44d45c44859759211886613abb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98d38ae30a1b4c8413fe986521809c89fcc25def35a5b439a884b8b808171abaac3d89991c920a761ede1f7933eae3cc11889ab30d2f6cd8e8bcef2abeda83f5', 'id': '76306f9b-7c71-47c1-9ccf-f2e50c4baaf9', 'created_at': datetime.datetime(2026, 9, 9, 15, 58, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 58, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/76306f9b-7c71-47c1-9ccf-f2e50c4baaf9/file', 'properties': {}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42020998-ad76-48c9-8205-4ad593daeb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:13 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Volume volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 (c77cf8b9-13a7-494e-bcf7-fbdffbd40d45): created successfully Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42020998-ad76-48c9-8205-4ad593daeb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:13 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Flow 'volume_create_manager' (97b1771f-e17a-452e-9b69-e5421765a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7556de95-4d60-43c2-8c3c-e39945474ceb tempest-VolumeImageDependencyTests-959828969 None] Created volume successfully. Sep 09 17:58:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Acquiring lock "cinder-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Lock "cinder-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Acquiring lock "cinder-quobyte-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Lock "cinder-quobyte-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:14 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d9fd18-8259-4cb4-81c9-cc812a92ed44]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:14 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 Sep 09 17:58:14 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:14 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45" returned: 0 in 0.415s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:15 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45 Sep 09 17:58:15 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Flow 'volume_create_manager' (31fbfbf5-e0bc-4a1e-b890-8d1f98f5a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a03e65-6d3f-4753-9ef1-d5575ffc22df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:15 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a03e65-6d3f-4753-9ef1-d5575ffc22df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-946696040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e6885b-ae21-4a98-93b1-067bf50ea1ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7c9170247f48ecbe4cc00dea0fea81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:15Z,use_quota=True,user_id='8477a7e9d4374902bd33e3daec4b6aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1c767a-3d3c-433a-a413-726bdd6b23c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1c767a-3d3c-433a-a413-726bdd6b23c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e4d31a-5cdb-4750-9856-16edfd822860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e4d31a-5cdb-4750-9856-16edfd822860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e6885b-ae21-4a98-93b1-067bf50ea1ab', 'volume_name': 'volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfcb9af-39e1-42f7-b0b4-9c60e5c7321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfcb9af-39e1-42f7-b0b4-9c60e5c7321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93c7927-6cc4-4296-986f-d2da726cd2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:15 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Volume d4e6885b-ae21-4a98-93b1-067bf50ea1ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab', 'volume_size': 1} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-946696040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e6885b-ae21-4a98-93b1-067bf50ea1ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c7c9170247f48ecbe4cc00dea0fea81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:15Z,use_quota=True,user_id='8477a7e9d4374902bd33e3daec4b6aea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Creating volume d4e6885b-ae21-4a98-93b1-067bf50ea1ab {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:15 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45" returned: 0 in 0.344s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:15 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab 1073741824 Sep 09 17:58:15 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Lock "cinder-quobyte-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45" released by "delete_volume" :: held 0.844s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Created reservations ['cce20991-6788-43da-897c-ae2f7996c314', '6d86e605-472c-4d30-b34b-178035fcaab1', 'e3610f36-89a6-47bf-a9ba-c3800712a982', '8f6c1675-a81a-4b02-bccf-39e88371cbcb'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:15 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:15 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:15 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab 1073741824" returned: 0 in 0.452s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:15 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.273s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Deleted volume successfully. Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-687705dd-593e-4085-bb0b-5a1153387442 tempest-VolumeImageDependencyTests-959828969 None] Lock "cinder-c77cf8b9-13a7-494e-bcf7-fbdffbd40d45-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:15 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab Sep 09 17:58:15 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:16 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93c7927-6cc4-4296-986f-d2da726cd2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc22257f-a0d0-4b80-8cc3-a56a7100c2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:16 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Volume volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab (d4e6885b-ae21-4a98-93b1-067bf50ea1ab): created successfully Sep 09 17:58:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc22257f-a0d0-4b80-8cc3-a56a7100c2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Flow 'volume_create_manager' (31fbfbf5-e0bc-4a1e-b890-8d1f98f5a270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5592debd-1971-49a6-b975-ade1b9fdbba3 tempest-VolumesMetadataTest-675704341 None] Created volume successfully. Sep 09 17:58:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Acquiring lock "cinder-d4e6885b-ae21-4a98-93b1-067bf50ea1ab-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Lock "cinder-d4e6885b-ae21-4a98-93b1-067bf50ea1ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Acquiring lock "cinder-quobyte-d4e6885b-ae21-4a98-93b1-067bf50ea1ab" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Lock "cinder-quobyte-d4e6885b-ae21-4a98-93b1-067bf50ea1ab" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d1dc18-75fe-424b-a483-1f2ea638bc12]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:17 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab Sep 09 17:58:17 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:17 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab" returned: 0 in 0.461s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:18 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab Sep 09 17:58:18 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:18 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d4e6885b-ae21-4a98-93b1-067bf50ea1ab" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Lock "cinder-quobyte-d4e6885b-ae21-4a98-93b1-067bf50ea1ab" released by "delete_volume" :: held 0.792s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Created reservations ['e09f1f91-8165-479e-8693-250bb015b86a', '9248bc58-88f8-4675-a697-13555c99a26c', 'd600545c-8abf-43c4-b3f8-c8962b9b9662', '0d592872-980f-4ba8-8964-804ac4fb4e6a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:18 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:18 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:18 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.305s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:18 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Deleted volume successfully. Sep 09 17:58:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74030350-6143-4c39-953a-c9802115af75 tempest-VolumesMetadataTest-675704341 None] Lock "cinder-d4e6885b-ae21-4a98-93b1-067bf50ea1ab-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Flow 'volume_create_manager' (94005375-1c0b-4346-b443-9d8c596ffd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a687401-3ea1-4e55-80f1-029fc561a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a687401-3ea1-4e55-80f1-029fc561a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-365173064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3320050a-5fa7-4787-bd68-07ad6f2fd998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72219de3b3b4229a09418d77a707b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:23Z,use_quota=True,user_id='7168d230950c45c094117aaa21ddee93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a9dd13-bbd1-4b01-bfe2-7a872d4c4b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a9dd13-bbd1-4b01-bfe2-7a872d4c4b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9384dd5-0dd9-49d8-9d04-871cf9e20cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9384dd5-0dd9-49d8-9d04-871cf9e20cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3320050a-5fa7-4787-bd68-07ad6f2fd998', 'volume_name': 'volume-3320050a-5fa7-4787-bd68-07ad6f2fd998', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786e7d7-9510-427f-add2-c9e29043c260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786e7d7-9510-427f-add2-c9e29043c260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9401e6ab-cf31-4464-a4f4-38cc8877d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:23 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Volume 3320050a-5fa7-4787-bd68-07ad6f2fd998: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3320050a-5fa7-4787-bd68-07ad6f2fd998', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Trying to clone 3320050a-5fa7-4787-bd68-07ad6f2fd998 from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 17:58:23 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 17:58:23 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Image download 20.69 MB at 20.69 MB/s Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82de023-92fb-4f90-89d5-051db95007d1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:24 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD Sep 09 17:58:24 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:24 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe is fetched for user 7168d230950c45c094117aaa21ddee93. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[225b1864-3e11-43bc-b128-419e0e09fdc5]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:24 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD Sep 09 17:58:24 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:24 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-365173064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3320050a-5fa7-4787-bd68-07ad6f2fd998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a72219de3b3b4229a09418d77a707b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:23Z,use_quota=True,user_id='7168d230950c45c094117aaa21ddee93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Creating volume 3320050a-5fa7-4787-bd68-07ad6f2fd998 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:24 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:24 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 1073741824 Sep 09 17:58:24 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:25 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 1073741824" returned: 0 in 0.499s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:25 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 Sep 09 17:58:25 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:25 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998" returned: 0 in 0.270s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:25 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Attempting download of d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 3320050a-5fa7-4787-bd68-07ad6f2fd998. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 17:58:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb091d6-4d04-43b2-8845-c34083f23a9b]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_b31ffhju {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:25 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_b31ffhju Sep 09 17:58:25 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:26 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_b31ffhju" returned: 0 in 0.374s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_b31ffhju {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:26 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_b31ffhju Sep 09 17:58:26 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:26 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_b31ffhju" returned: 1 in 0.348s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_b31ffhju' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[54307ad6-f005-4002-90af-07aa24a37d42]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:26 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD Sep 09 17:58:26 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:26 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe was qcow2, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 17:58:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:26 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 Sep 09 17:58:26 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:28 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998" returned: 0 in 2.077s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:28 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_2qc5x1jrdevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:58:28 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Converted 112.00 MB image at 53.89 MB/s Sep 09 17:58:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:28 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 1G Sep 09 17:58:28 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:29 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 1G" returned: 0 in 0.364s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Downloaded image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 3320050a-5fa7-4787-bd68-07ad6f2fd998 successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe for user 7168d230950c45c094117aaa21ddee93 is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Marking volume 3320050a-5fa7-4787-bd68-07ad6f2fd998 as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Copying metadata from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe to 3320050a-5fa7-4787-bd68-07ad6f2fd998. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Creating volume glance metadata for volume 3320050a-5fa7-4787-bd68-07ad6f2fd998 backed by image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9401e6ab-cf31-4464-a4f4-38cc8877d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3320050a-5fa7-4787-bd68-07ad6f2fd998', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a5f257-646d-4a69-8e68-3f1f0405a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:29 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Volume volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 (3320050a-5fa7-4787-bd68-07ad6f2fd998): created successfully Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a5f257-646d-4a69-8e68-3f1f0405a940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Flow 'volume_create_manager' (94005375-1c0b-4346-b443-9d8c596ffd8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:29 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0ce7c20c-882a-4d96-9579-23ddf6140c4e tempest-VolumesImageMetadata-1372493041 None] Created volume successfully. Sep 09 17:58:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Acquiring lock "cinder-3320050a-5fa7-4787-bd68-07ad6f2fd998-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Lock "cinder-3320050a-5fa7-4787-bd68-07ad6f2fd998-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Acquiring lock "cinder-quobyte-3320050a-5fa7-4787-bd68-07ad6f2fd998" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Lock "cinder-quobyte-3320050a-5fa7-4787-bd68-07ad6f2fd998" acquired by "delete_volume" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a144b48d-7e21-4e4b-90c3-6c9f1539bafa]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:31 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 Sep 09 17:58:31 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:31 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998" returned: 0 in 0.379s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:31 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998 Sep 09 17:58:31 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:31 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3320050a-5fa7-4787-bd68-07ad6f2fd998" returned: 0 in 0.244s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Lock "cinder-quobyte-3320050a-5fa7-4787-bd68-07ad6f2fd998" released by "delete_volume" :: held 0.685s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Created reservations ['1ef25d53-292b-4def-b6f1-df59cd21391a', '7048cf46-d7a9-4b61-9767-3a49896955bd', '99c83d49-ae86-4b40-a59e-e30d3a19a0f9', '0d8fea94-4ce9-4715-9fdc-9d1426324993'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:31 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:31 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:32 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.280s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:32 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:32 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Deleted volume successfully. Sep 09 17:58:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d57ab4eb-89de-47f5-90c4-92a0cd662a8c tempest-VolumesImageMetadata-1372493041 None] Lock "cinder-3320050a-5fa7-4787-bd68-07ad6f2fd998-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Flow 'volume_create_manager' (75241e78-60fe-4cb4-b2bb-ec227b57d6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a534e834-8990-4f1e-8f4d-0699c633a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a534e834-8990-4f1e-8f4d-0699c633a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1990887201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4b3acf-a1e3-4425-85f6-5136f526103b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06233a73d9994fbbb1d3cebbbfbb2334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:34Z,use_quota=True,user_id='9e4f8d9103ab42a1a3103b62be3c1b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad27461-0c3a-413d-926c-1d5a521692e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad27461-0c3a-413d-926c-1d5a521692e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f905036-2e04-4465-8bb0-dba3dfa3e420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f905036-2e04-4465-8bb0-dba3dfa3e420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4b3acf-a1e3-4425-85f6-5136f526103b', 'volume_name': 'volume-7d4b3acf-a1e3-4425-85f6-5136f526103b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38ac59e-b6f7-4737-ac05-0ef6b59ec634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38ac59e-b6f7-4737-ac05-0ef6b59ec634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd0cd5c-09a0-4217-8a6c-76e0b743415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:34 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Volume 7d4b3acf-a1e3-4425-85f6-5136f526103b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4b3acf-a1e3-4425-85f6-5136f526103b', 'volume_size': 1} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1990887201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4b3acf-a1e3-4425-85f6-5136f526103b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06233a73d9994fbbb1d3cebbbfbb2334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:34Z,use_quota=True,user_id='9e4f8d9103ab42a1a3103b62be3c1b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Creating volume 7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:34 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:34 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b 1073741824 Sep 09 17:58:34 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:34 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b 1073741824" returned: 0 in 0.425s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:34 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:58:34 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:34 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd0cd5c-09a0-4217-8a6c-76e0b743415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4b3acf-a1e3-4425-85f6-5136f526103b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddd668e-0141-4334-b830-a0a58d77a899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:34 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Volume volume-7d4b3acf-a1e3-4425-85f6-5136f526103b (7d4b3acf-a1e3-4425-85f6-5136f526103b): created successfully Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddd668e-0141-4334-b830-a0a58d77a899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Flow 'volume_create_manager' (75241e78-60fe-4cb4-b2bb-ec227b57d6e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-150d1ba3-6da9-4827-b063-5eecd68eb6af tempest-VolumesActionsTest-1709904163 None] Created volume successfully. Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Flow 'volume_create_manager' (7bf95833-0ef0-4eb4-8b80-2017bee96395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f79173-3b6f-43b4-b64a-e3f560f2d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f79173-3b6f-43b4-b64a-e3f560f2d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1241738130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c8ec4d-a805-4887-8f60-ac81f8b19187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02656f4c3bd744ae97bdba55acecd98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:36Z,use_quota=True,user_id='9e24132924a0403197fa1b15643fae71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828fa179-c9b5-4951-a90a-51201b0fc450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828fa179-c9b5-4951-a90a-51201b0fc450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e40bba-008a-47f6-8c31-9f804828d2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e40bba-008a-47f6-8c31-9f804828d2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c8ec4d-a805-4887-8f60-ac81f8b19187', 'volume_name': 'volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d3db99-20de-47b2-ace0-b465af9872c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d3db99-20de-47b2-ace0-b465af9872c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca0446b-11cf-475a-be5b-ad0fd71a9490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:36 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Volume a6c8ec4d-a805-4887-8f60-ac81f8b19187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187', 'volume_size': 1} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1241738130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c8ec4d-a805-4887-8f60-ac81f8b19187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02656f4c3bd744ae97bdba55acecd98d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:36Z,use_quota=True,user_id='9e24132924a0403197fa1b15643fae71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Creating volume a6c8ec4d-a805-4887-8f60-ac81f8b19187 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:36 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:36 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 1073741824 Sep 09 17:58:36 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:36 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 1073741824" returned: 0 in 0.476s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:36 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 Sep 09 17:58:36 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:37 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187" returned: 0 in 0.267s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca0446b-11cf-475a-be5b-ad0fd71a9490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4849d397-1dd5-4809-8d1d-7a393150e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Volume volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 (a6c8ec4d-a805-4887-8f60-ac81f8b19187): created successfully Sep 09 17:58:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4849d397-1dd5-4809-8d1d-7a393150e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Flow 'volume_create_manager' (7bf95833-0ef0-4eb4-8b80-2017bee96395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-049a2d2a-e19c-49f7-ab02-c69c57c1a2d7 tempest-SnapshotMetadataTestJSON-2059828710 None] Created volume successfully. Sep 09 17:58:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Creating offline snapshot 0ff9b50d-784a-4552-af79-5cd0880202b8 of volume a6c8ec4d-a805-4887-8f60-ac81f8b19187 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:58:38 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e7458a-19f6-4663-85e5-6df6a5687c4d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:38 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 Sep 09 17:58:38 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:38 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187" returned: 0 in 0.395s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:38 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 1G Sep 09 17:58:38 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:39 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 1G" returned: 0 in 0.436s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:39 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 Sep 09 17:58:39 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:39 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8" returned: 0 in 0.542s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:39 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 is being set with open permissions: ugo+rw Sep 09 17:58:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:39 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 Sep 09 17:58:39 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:40 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8" returned: 0 in 0.349s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:40 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.info Sep 09 17:58:40 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:40 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.info" returned: 0 in 0.283s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:40 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.info is being set with open permissions: ugo+rw Sep 09 17:58:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:40 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.info Sep 09 17:58:40 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:40 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.info" returned: 0 in 0.253s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:40 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d16f5000-c3b4-4d25-999c-5d76f60a9227 tempest-SnapshotMetadataTestJSON-2059828710 None] Create snapshot completed successfully Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5c73913b-dfaf-491d-a779-f710e3cec7bc tempest-VolumesActionsTest-1709904163 None] Acquiring lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b" by "attach_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5c73913b-dfaf-491d-a779-f710e3cec7bc tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b" acquired by "attach_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5c73913b-dfaf-491d-a779-f710e3cec7bc tempest-VolumesActionsTest-1709904163 None] Attaching volume 7d4b3acf-a1e3-4425-85f6-5136f526103b to instance e4fe5bd4-9031-496b-9bfa-711dce7d8e9d at mountpoint /dev/vdb on host None. Sep 09 17:58:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5c73913b-dfaf-491d-a779-f710e3cec7bc tempest-VolumesActionsTest-1709904163 None] Attach volume completed successfully. Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5c73913b-dfaf-491d-a779-f710e3cec7bc tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b" released by "attach_volume" :: held 0.133s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ad5f88e9-2006-42bf-8758-d0da4ffd454a tempest-VolumesActionsTest-1709904163 None] Acquiring lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-detach_volume" by "detach_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ad5f88e9-2006-42bf-8758-d0da4ffd454a tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ad5f88e9-2006-42bf-8758-d0da4ffd454a tempest-VolumesActionsTest-1709904163 None] Detaching volume 7d4b3acf-a1e3-4425-85f6-5136f526103b from instance e4fe5bd4-9031-496b-9bfa-711dce7d8e9d. Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "cinder-0ff9b50d-784a-4552-af79-5cd0880202b8-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ad5f88e9-2006-42bf-8758-d0da4ffd454a tempest-VolumesActionsTest-1709904163 None] Detach volume completed successfully. Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-0ff9b50d-784a-4552-af79-5cd0880202b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "cinder-quobyte-a6c8ec4d-a805-4887-8f60-ac81f8b19187" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ad5f88e9-2006-42bf-8758-d0da4ffd454a tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-quobyte-a6c8ec4d-a805-4887-8f60-ac81f8b19187" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "cinder-quobyte-0ff9b50d-784a-4552-af79-5cd0880202b8" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-quobyte-0ff9b50d-784a-4552-af79-5cd0880202b8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Deleting offline snapshot 0ff9b50d-784a-4552-af79-5cd0880202b8 of volume a6c8ec4d-a805-4887-8f60-ac81f8b19187 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] snapshot_file for this snap is: volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4168b217-5448-4495-8606-880d8b5b374c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:42 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 Sep 09 17:58:42 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:43 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8" returned: 0 in 0.414s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:58:43 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffd557d-0041-44a3-95f3-0ab2bfba0b39]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:43 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 Sep 09 17:58:43 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:43 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187" returned: 0 in 0.445s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:43 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 Sep 09 17:58:43 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:43 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8" returned: 0 in 0.414s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:43 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8 Sep 09 17:58:43 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:44 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187.0ff9b50d-784a-4552-af79-5cd0880202b8" returned: 0 in 0.281s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-quobyte-0ff9b50d-784a-4552-af79-5cd0880202b8" released by "_delete_snapshot" :: held 1.744s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-quobyte-a6c8ec4d-a805-4887-8f60-ac81f8b19187" released by "delete_snapshot" :: held 1.764s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Created reservations ['069a47dc-feb3-4ce2-95a2-94ca51c51b93', '14a26e00-3bf2-4495-bf55-f1c746c3a339', '4feb5ad7-3ea3-4159-b93a-e4127682bc30', '14e3575d-4e62-43c5-9112-8c21f7552c9b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:44 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Delete snapshot completed successfully. Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-fdd416b0-85ce-413c-8f59-3734af5a9d02 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-0ff9b50d-784a-4552-af79-5cd0880202b8-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "cinder-a6c8ec4d-a805-4887-8f60-ac81f8b19187-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-a6c8ec4d-a805-4887-8f60-ac81f8b19187-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "cinder-quobyte-a6c8ec4d-a805-4887-8f60-ac81f8b19187" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-quobyte-a6c8ec4d-a805-4887-8f60-ac81f8b19187" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ed5195-eaed-4fd6-ba60-5f1eeff64949]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:44 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 Sep 09 17:58:44 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:45 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:45 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187 Sep 09 17:58:45 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:45 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-a6c8ec4d-a805-4887-8f60-ac81f8b19187" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-quobyte-a6c8ec4d-a805-4887-8f60-ac81f8b19187" released by "delete_volume" :: held 0.660s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Created reservations ['5afcfd46-c1b3-4eec-8668-eaf0ac66ed25', '13465a96-9803-469b-b509-449cd2e945aa', 'b57698ce-8b90-4f7d-b059-4554eeb18083', 'cde26d5f-f7c8-40f1-a7a6-0e475e4f933d'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:45 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:45 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:45 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Deleted volume successfully. Sep 09 17:58:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dda98d2d-7109-4368-99e9-390d313ddb60 tempest-SnapshotMetadataTestJSON-2059828710 None] Lock "cinder-a6c8ec4d-a805-4887-8f60-ac81f8b19187-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c79520ad-463e-4d45-b715-03e93fdb3471 tempest-VolumesActionsTest-1709904163 None] Acquiring lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b" by "attach_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c79520ad-463e-4d45-b715-03e93fdb3471 tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b" acquired by "attach_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:53 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=138,cinder:UPDATE=192,cinder:INSERT=60,cinder:DELETE=18 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:58:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c79520ad-463e-4d45-b715-03e93fdb3471 tempest-VolumesActionsTest-1709904163 None] Attaching volume 7d4b3acf-a1e3-4425-85f6-5136f526103b to instance 9dc167d2-cc18-412a-97bf-ce4622cc6ff6 at mountpoint /dev/vdb on host None. Sep 09 17:58:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c79520ad-463e-4d45-b715-03e93fdb3471 tempest-VolumesActionsTest-1709904163 None] Attach volume completed successfully. Sep 09 17:58:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c79520ad-463e-4d45-b715-03e93fdb3471 tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b" released by "attach_volume" :: held 0.102s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64384c96-43cc-4bd6-9d6e-016a4e9ed282 tempest-VolumesActionsTest-1709904163 None] Acquiring lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-detach_volume" by "detach_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64384c96-43cc-4bd6-9d6e-016a4e9ed282 tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-64384c96-43cc-4bd6-9d6e-016a4e9ed282 tempest-VolumesActionsTest-1709904163 None] Detaching volume 7d4b3acf-a1e3-4425-85f6-5136f526103b from instance 9dc167d2-cc18-412a-97bf-ce4622cc6ff6. Sep 09 17:58:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-64384c96-43cc-4bd6-9d6e-016a4e9ed282 tempest-VolumesActionsTest-1709904163 None] Detach volume completed successfully. Sep 09 17:58:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-64384c96-43cc-4bd6-9d6e-016a4e9ed282 tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Flow 'volume_create_manager' (9893280d-b62a-41c1-a7bb-9740fe68e334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c953c0e-6185-4d30-ba8e-138c5c3aba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c953c0e-6185-4d30-ba8e-138c5c3aba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1496524694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f85ff39-267d-4318-9a45-5c0064a0eee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94eb54d0e2e94a2d8a8eec0d73f1c722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:55Z,use_quota=True,user_id='3fe5231bd5dc4fb38e9419365cd77e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15a6a63-c463-4532-86d8-32864f208076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15a6a63-c463-4532-86d8-32864f208076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27e5d4d-880f-4ebc-8bd7-20baf8371077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27e5d4d-880f-4ebc-8bd7-20baf8371077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f85ff39-267d-4318-9a45-5c0064a0eee3', 'volume_name': 'volume-7f85ff39-267d-4318-9a45-5c0064a0eee3', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2d472e-dca8-4332-a869-3e8e83814fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2d472e-dca8-4332-a869-3e8e83814fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db694843-9c45-4745-958e-aa9b6a82243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Volume 7f85ff39-267d-4318-9a45-5c0064a0eee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f85ff39-267d-4318-9a45-5c0064a0eee3', 'volume_size': 1} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1496524694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f85ff39-267d-4318-9a45-5c0064a0eee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94eb54d0e2e94a2d8a8eec0d73f1c722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:55Z,use_quota=True,user_id='3fe5231bd5dc4fb38e9419365cd77e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Creating volume 7f85ff39-267d-4318-9a45-5c0064a0eee3 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:58:55 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:58:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:55 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 1073741824 Sep 09 17:58:55 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:56 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 1073741824" returned: 0 in 0.474s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:56 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 Sep 09 17:58:56 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:56 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db694843-9c45-4745-958e-aa9b6a82243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f85ff39-267d-4318-9a45-5c0064a0eee3', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3762ead2-493b-473f-8e45-5f332838c8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:56 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Volume volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 (7f85ff39-267d-4318-9a45-5c0064a0eee3): created successfully Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3762ead2-493b-473f-8e45-5f332838c8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:56 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Flow 'volume_create_manager' (9893280d-b62a-41c1-a7bb-9740fe68e334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f4541455-ce9b-42d6-90f8-f4d30f553b5e tempest-VolumesTransfersTest-654232782 None] Created volume successfully. Sep 09 17:58:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2a46df10-db07-4744-a7f1-b461a84ae412 tempest-VolumesTransfersTest-579458067 None] Transfer volume completed successfully. Sep 09 17:58:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Acquiring lock "cinder-7f85ff39-267d-4318-9a45-5c0064a0eee3-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Lock "cinder-7f85ff39-267d-4318-9a45-5c0064a0eee3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Acquiring lock "cinder-quobyte-7f85ff39-267d-4318-9a45-5c0064a0eee3" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:58:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Lock "cinder-quobyte-7f85ff39-267d-4318-9a45-5c0064a0eee3" acquired by "delete_volume" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:58:57 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c915a2e1-c691-404b-a29a-c9b6676fef42]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:57 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 Sep 09 17:58:57 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:58 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3" returned: 0 in 0.367s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aca9ea-670d-4ae8-987a-790f554b3697]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:58 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3 Sep 09 17:58:58 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:58 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:58:58 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:58 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7f85ff39-267d-4318-9a45-5c0064a0eee3" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Lock "cinder-quobyte-7f85ff39-267d-4318-9a45-5c0064a0eee3" released by "delete_volume" :: held 0.657s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Created reservations ['c67468bd-5593-4874-b3cd-f872071e6bbd', 'a7d9e6e0-854d-4c7c-85f4-698dcfbbdc0a', '7177d122-6ab1-44df-a401-f2b31c2cf76e', '32ed0884-80f5-4080-9fc3-6d62354ad3d1'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:58 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.374s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:58 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af9ec97-a065-4221-936a-e46fc7c6dbb6]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:58 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:58 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:58:58 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:58 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:58:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Deleted volume successfully. Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9d55405f-6ff8-434c-9560-c935f8d2b9fd tempest-VolumesTransfersTest-1680792875 None] Lock "cinder-7f85ff39-267d-4318-9a45-5c0064a0eee3-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:58:58 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.366s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:58:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aa4dc47a-beb4-4f8a-a5d3-1f40084fcfeatzxoihpy.img {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:58:58 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aa4dc47a-beb4-4f8a-a5d3-1f40084fcfeatzxoihpy.img Sep 09 17:58:58 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Flow 'volume_create_manager' (e1ad03f5-ce10-4bb9-86b2-afcff6d8efc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6844ee0-2594-424c-8ea0-530ba7386ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6844ee0-2594-424c-8ea0-530ba7386ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1034139787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94eb54d0e2e94a2d8a8eec0d73f1c722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:59Z,use_quota=True,user_id='3fe5231bd5dc4fb38e9419365cd77e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3925ed-0bc4-484e-9ef2-b87cea74ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3925ed-0bc4-484e-9ef2-b87cea74ccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed140bb-55c3-44b2-89d5-0b9e573b43af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed140bb-55c3-44b2-89d5-0b9e573b43af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe', 'volume_name': 'volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0bec7c-50b6-4cd2-8eab-adea392cf0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0bec7c-50b6-4cd2-8eab-adea392cf0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183b7ae8-9b3d-4cf7-82aa-15c0fd9ea923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:58:59 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Volume 10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe', 'volume_size': 1} Sep 09 17:58:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:02 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aa4dc47a-beb4-4f8a-a5d3-1f40084fcfeatzxoihpy.img" returned: 0 in 3.985s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[623692c2-9c42-498d-a83c-1c15836841e6]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:02 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:59:02 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:03 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.498s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:03 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aa4dc47a-beb4-4f8a-a5d3-1f40084fcfeatzxoihpy.img {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:59:03 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Converted 1024.00 MB image at 256.91 MB/s Sep 09 17:59:03 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] aa4dc47a-beb4-4f8a-a5d3-1f40084fcfea was raw, no need to convert to raw {{(pid=87202) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 17:59:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:59:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:05 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:59:05 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:05 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:59:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:59:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:59:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:59:09 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:INSERT=27,cinder:UPDATE=69,cinder:SELECT=65,cinder:DELETE=5 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:59:13 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.145s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Uploaded volume to glance image-id: aa4dc47a-beb4-4f8a-a5d3-1f40084fcfea. {{(pid=87202) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.628s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1034139787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94eb54d0e2e94a2d8a8eec0d73f1c722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:58:59Z,use_quota=True,user_id='3fe5231bd5dc4fb38e9419365cd77e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Creating volume 10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:59:22 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:22 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe 1073741824 Sep 09 17:59:22 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1f553075-2e4d-4afd-beb0-8bfbc6d27f55 tempest-VolumesActionsTest-1709904163 None] Copy volume to image completed successfully. Sep 09 17:59:22 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe 1073741824" returned: 0 in 0.409s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:22 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe Sep 09 17:59:22 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:22 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe" returned: 0 in 0.251s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183b7ae8-9b3d-4cf7-82aa-15c0fd9ea923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecd60fd-9bb1-4723-a51a-f47192e14b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:22 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Volume volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe (10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe): created successfully Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecd60fd-9bb1-4723-a51a-f47192e14b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Flow 'volume_create_manager' (e1ad03f5-ce10-4bb9-86b2-afcff6d8efc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6b22a7fc-6512-4dc2-af83-0ed60f894c06 tempest-VolumesTransfersTest-654232782 None] Created volume successfully. Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Acquiring lock "cinder-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Lock "cinder-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Acquiring lock "cinder-quobyte-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Lock "cinder-quobyte-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa21873-867d-4819-b317-9e09168450cf]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:23 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe Sep 09 17:59:23 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:23 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe" returned: 0 in 0.371s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:23 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe Sep 09 17:59:23 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e9d1b-9edc-49b5-86de-a82f8da9115a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:23 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:59:23 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:24 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe" returned: 0 in 0.264s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Lock "cinder-quobyte-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe" released by "delete_volume" :: held 0.677s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Created reservations ['df4ed75f-c9de-469b-a8c3-bc28bd41c59e', '4111ef5c-4f7e-4689-a514-34247217d1f7', '6df87491-61fc-49a7-8a59-de6adb79944a', '00220ff7-3e95-45b9-9954-49e2b896ec55'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:24 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.376s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:24 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:59:24 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[47388fc6-7088-4559-810a-7edbec631c81]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:24 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:59:24 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:24 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:59:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Deleted volume successfully. Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-44dbb3fb-467e-4c58-86d5-2e1c96e7ec48 tempest-VolumesTransfersTest-1680792875 None] Lock "cinder-10d3c2d6-5c83-4ee0-a0fd-22a3dade6afe-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:24 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.415s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:24 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img Sep 09 17:59:24 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:29 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img" returned: 0 in 4.306s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13b366-a7b0-4a4e-9131-65d427e86005]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:29 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:59:29 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:29 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.602s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b, size 1024.00 MB, duration 4.31 sec, destination /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:59:29 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Converted 1024.00 MB image at 237.70 MB/s Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] aff0abfe-89ad-4810-9f16-54b42ac6ff2d was raw, converting to qcow2 {{(pid=87202) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5339e6f8-72d5-460c-bfae-f8134e5ccdc2]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:29 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img Sep 09 17:59:29 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:29 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:30 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img Sep 09 17:59:30 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:30 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img" returned: 1 in 0.319s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:59:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img /opt/stack/data/cinder/conversion/vol_upload_e6cpf2ti {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:30 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img /opt/stack/data/cinder/conversion/vol_upload_e6cpf2ti Sep 09 17:59:30 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:30 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img /opt/stack/data/cinder/conversion/vol_upload_e6cpf2ti" returned: 0 in 0.302s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:30 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Image conversion details: src /opt/stack/data/cinder/conversion/7d4b3acf-a1e3-4425-85f6-5136f526103b.temp_image.aff0abfe-89ad-4810-9f16-54b42ac6ff2di37eqr38.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_e6cpf2ti {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:59:30 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 09 17:59:30 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f9fc8f-79e7-481d-8cbe-db9d4c9a45f5]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e6cpf2ti {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:30 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e6cpf2ti Sep 09 17:59:30 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:30 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e6cpf2ti" returned: 0 in 0.348s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.684s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Uploaded volume to glance image-id: aff0abfe-89ad-4810-9f16-54b42ac6ff2d. {{(pid=87202) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 17:59:32 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-cf7fc612-f285-4213-9025-2c0a899f1d02 tempest-VolumesActionsTest-1709904163 None] Copy volume to image completed successfully. Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Flow 'volume_create_manager' (a89623b4-7e5e-4414-b353-952e8eb9be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e434391c-fd23-4bc5-b4b5-8e2e465c2e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e434391c-fd23-4bc5-b4b5-8e2e465c2e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2091180182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac699be-162e-41f7-b835-74a1662c8fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ff845ed1f54e24a237ab815a18affd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:59:34Z,use_quota=True,user_id='a0d7bcc8b2f042798522db17d6600a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4342688-a86e-45e3-ac55-dda829192265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4342688-a86e-45e3-ac55-dda829192265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7508c7-1f37-4f46-a5b5-43a51135c3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7508c7-1f37-4f46-a5b5-43a51135c3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ac699be-162e-41f7-b835-74a1662c8fda', 'volume_name': 'volume-2ac699be-162e-41f7-b835-74a1662c8fda', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313632a1-47b1-458b-b9c8-1167e862a4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313632a1-47b1-458b-b9c8-1167e862a4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c56ce97-f5c9-4163-ba64-e84853593b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Volume 2ac699be-162e-41f7-b835-74a1662c8fda: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ac699be-162e-41f7-b835-74a1662c8fda', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 17:59:33 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Trying to clone 2ac699be-162e-41f7-b835-74a1662c8fda from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Acquiring lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Acquiring lock "cinder-quobyte-7d4b3acf-a1e3-4425-85f6-5136f526103b" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Lock "cinder-quobyte-7d4b3acf-a1e3-4425-85f6-5136f526103b" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db2f268-35de-4e8e-a289-9177ef77baca]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 17:59:34 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Image download 20.69 MB at 20.69 MB/s Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a190810e-3c10-4771-a16b-b44f15beb9d6]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:34 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:59:34 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:34 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD Sep 09 17:59:34 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:34 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.380s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:34 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b Sep 09 17:59:34 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:34 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe is fetched for user a0d7bcc8b2f042798522db17d6600a73. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[678aed10-febe-4be3-929f-6967a06629f3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:34 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d4b3acf-a1e3-4425-85f6-5136f526103b" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:34 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD Sep 09 17:59:34 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Lock "cinder-quobyte-7d4b3acf-a1e3-4425-85f6-5136f526103b" released by "delete_volume" :: held 0.672s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Created reservations ['7e320247-7786-4dff-a007-12cb71648734', '90742fae-31e1-452a-b317-a30c81abf8b7', '9c0ac439-7260-49ff-b8b9-08e6947c4067', '07e4cadd-c327-440c-971c-f8850418cc78'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:34 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:59:34 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:35 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2091180182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac699be-162e-41f7-b835-74a1662c8fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ff845ed1f54e24a237ab815a18affd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:59:34Z,use_quota=True,user_id='a0d7bcc8b2f042798522db17d6600a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Creating volume 2ac699be-162e-41f7-b835-74a1662c8fda {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:59:35 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:35 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda 1073741824 Sep 09 17:59:35 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:35 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.259s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:59:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Deleted volume successfully. Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77e1fe88-80ba-45e0-9b27-20bc76856141 tempest-VolumesActionsTest-1709904163 None] Lock "cinder-7d4b3acf-a1e3-4425-85f6-5136f526103b-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:35 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda 1073741824" returned: 0 in 0.480s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:35 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda Sep 09 17:59:35 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:35 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Attempting download of d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 2ac699be-162e-41f7-b835-74a1662c8fda. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bddc7ff-0cc8-4ccc-8f49-767d54480d09]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_aqys3pv5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:36 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_aqys3pv5 Sep 09 17:59:36 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:36 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_aqys3pv5" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_aqys3pv5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:36 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_aqys3pv5 Sep 09 17:59:36 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:36 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_aqys3pv5" returned: 1 in 0.351s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_aqys3pv5' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d1e45-8b08-480b-9412-8e29e17e5937]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:36 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD Sep 09 17:59:36 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:36 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe was qcow2, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 17:59:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:37 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda Sep 09 17:59:37 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:38 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda" returned: 0 in 1.773s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:38 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_hphhyf__devstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:59:38 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Converted 112.00 MB image at 63.14 MB/s Sep 09 17:59:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:38 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda 1G Sep 09 17:59:38 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:39 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda 1G" returned: 0 in 0.404s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Downloaded image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 2ac699be-162e-41f7-b835-74a1662c8fda successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe for user a0d7bcc8b2f042798522db17d6600a73 is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Marking volume 2ac699be-162e-41f7-b835-74a1662c8fda as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Copying metadata from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe to 2ac699be-162e-41f7-b835-74a1662c8fda. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Creating volume glance metadata for volume 2ac699be-162e-41f7-b835-74a1662c8fda backed by image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c56ce97-f5c9-4163-ba64-e84853593b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac699be-162e-41f7-b835-74a1662c8fda', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f33122f-af58-4fec-9ccb-980d5bfd2ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:39 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Volume volume-2ac699be-162e-41f7-b835-74a1662c8fda (2ac699be-162e-41f7-b835-74a1662c8fda): created successfully Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f33122f-af58-4fec-9ccb-980d5bfd2ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Flow 'volume_create_manager' (a89623b4-7e5e-4414-b353-952e8eb9be67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:39 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0ed8b81d-9f77-4cd2-9157-448025602acc tempest-VolumesExtendTest-1879359427 None] Created volume successfully. Sep 09 17:59:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1ef189ae-36aa-4c76-89de-b12f1c55be71 tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1ef189ae-36aa-4c76-89de-b12f1c55be71 tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5d153-6a33-4cf9-a3c2-e1b3a82be475]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1ef189ae-36aa-4c76-89de-b12f1c55be71 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:40 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda Sep 09 17:59:40 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:40 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1ef189ae-36aa-4c76-89de-b12f1c55be71 tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda" returned: 0 in 0.411s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1ef189ae-36aa-4c76-89de-b12f1c55be71 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda 2G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1ef189ae-36aa-4c76-89de-b12f1c55be71 tempest-VolumesExtendTest-1879359427 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda 2G" returned: 0 in 0.100s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1ef189ae-36aa-4c76-89de-b12f1c55be71 tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.541s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:40 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1ef189ae-36aa-4c76-89de-b12f1c55be71 tempest-VolumesExtendTest-1879359427 None] Extend volume completed successfully. Sep 09 17:59:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Acquiring lock "cinder-2ac699be-162e-41f7-b835-74a1662c8fda-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Lock "cinder-2ac699be-162e-41f7-b835-74a1662c8fda-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Acquiring lock "cinder-quobyte-2ac699be-162e-41f7-b835-74a1662c8fda" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Lock "cinder-quobyte-2ac699be-162e-41f7-b835-74a1662c8fda" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:41 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d2b379-1cf7-4f1e-a653-0bb4b282b79a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:41 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda Sep 09 17:59:41 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:42 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:42 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda Sep 09 17:59:42 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:42 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2ac699be-162e-41f7-b835-74a1662c8fda" returned: 0 in 0.237s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Lock "cinder-quobyte-2ac699be-162e-41f7-b835-74a1662c8fda" released by "delete_volume" :: held 0.648s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Created reservations ['6aa83a02-b5aa-4528-90fa-6774abb13e14', 'c03a6439-3f27-412b-a209-cd0cb018835c', 'c0c0e05a-b26f-40f1-a9f6-5ada09106d2d', '96643e5a-016a-4dd4-8dd7-b34a6dacf407'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:42 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:59:42 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:42 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.287s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:59:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Deleted volume successfully. Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-afd43e9b-071f-4110-80e3-31ffee780a1b tempest-VolumesExtendTest-1879359427 None] Lock "cinder-2ac699be-162e-41f7-b835-74a1662c8fda-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Flow 'volume_create_manager' (9e24bcfc-3e4a-4288-81ea-9b24146bf826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4366768c-5cce-4ab5-b24b-ea0079d17db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4366768c-5cce-4ab5-b24b-ea0079d17db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1438665819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8e6e00-c688-4492-934f-5f87fc44cf46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478f87f7de140ad9fd98ab477721801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:59:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:59:43Z,use_quota=True,user_id='bd30038c786d4f5faad2e77dc4d6e672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c1b25d-9877-4285-ab40-4d694893877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c1b25d-9877-4285-ab40-4d694893877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321ca890-aa28-43e0-92ff-7745e1ee32ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321ca890-aa28-43e0-92ff-7745e1ee32ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca8e6e00-c688-4492-934f-5f87fc44cf46', 'volume_name': 'volume-ca8e6e00-c688-4492-934f-5f87fc44cf46', 'volume_size': 2}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c03083-b125-4a83-a336-6404f526123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c03083-b125-4a83-a336-6404f526123f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ab23f3-fe55-43f0-853f-3027ab5942bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:42 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Volume ca8e6e00-c688-4492-934f-5f87fc44cf46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca8e6e00-c688-4492-934f-5f87fc44cf46', 'volume_size': 2} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1438665819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca8e6e00-c688-4492-934f-5f87fc44cf46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2478f87f7de140ad9fd98ab477721801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:59:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:59:43Z,use_quota=True,user_id='bd30038c786d4f5faad2e77dc4d6e672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Creating volume ca8e6e00-c688-4492-934f-5f87fc44cf46 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:59:43 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 2147483648 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:43 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 2147483648 Sep 09 17:59:43 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Flow 'volume_create_manager' (2d564a02-c7f4-4251-8c67-e4119e343a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61be4ad-1f83-4b50-a5c8-70dc5402e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61be4ad-1f83-4b50-a5c8-70dc5402e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-624304305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9461936-ece0-443b-9561-de0e048cd970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ff845ed1f54e24a237ab815a18affd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:59:43Z,use_quota=True,user_id='a0d7bcc8b2f042798522db17d6600a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fd3b2f-36df-483f-b676-5b1bcd4785f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fd3b2f-36df-483f-b676-5b1bcd4785f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b2c6ca-4cc6-46bb-942f-d4fd34bb3c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b2c6ca-4cc6-46bb-942f-d4fd34bb3c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9461936-ece0-443b-9561-de0e048cd970', 'volume_name': 'volume-c9461936-ece0-443b-9561-de0e048cd970', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4745874-d851-42e3-bd70-a0f0e773245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4745874-d851-42e3-bd70-a0f0e773245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68611c32-5942-4aa4-96a4-601ad96e05d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:43 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Volume c9461936-ece0-443b-9561-de0e048cd970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9461936-ece0-443b-9561-de0e048cd970', 'volume_size': 1} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:43 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 2147483648" returned: 0 in 0.468s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:43 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 Sep 09 17:59:43 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:43 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46" returned: 0 in 0.229s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.354s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-624304305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9461936-ece0-443b-9561-de0e048cd970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2ff845ed1f54e24a237ab815a18affd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:59:43Z,use_quota=True,user_id='a0d7bcc8b2f042798522db17d6600a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Creating volume c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:59:43 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:43 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 1073741824 Sep 09 17:59:43 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ab23f3-fe55-43f0-853f-3027ab5942bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca8e6e00-c688-4492-934f-5f87fc44cf46', 'volume_size': 2}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a94e3f-0a5e-41b0-bf74-f1c083e902b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:43 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Volume volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 (ca8e6e00-c688-4492-934f-5f87fc44cf46): created successfully Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a94e3f-0a5e-41b0-bf74-f1c083e902b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Flow 'volume_create_manager' (9e24bcfc-3e4a-4288-81ea-9b24146bf826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:43 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a2282933-648b-4723-b4c3-27538140360e tempest-VolumesCloneNegativeTest-2115523662 None] Created volume successfully. Sep 09 17:59:44 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 1073741824" returned: 0 in 0.390s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:44 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 Sep 09 17:59:44 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:44 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970" returned: 0 in 0.232s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68611c32-5942-4aa4-96a4-601ad96e05d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9461936-ece0-443b-9561-de0e048cd970', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa546737-42c1-4421-8811-fdc127f96cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:44 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Volume volume-c9461936-ece0-443b-9561-de0e048cd970 (c9461936-ece0-443b-9561-de0e048cd970): created successfully Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa546737-42c1-4421-8811-fdc127f96cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Flow 'volume_create_manager' (2d564a02-c7f4-4251-8c67-e4119e343a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:44 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-90d12a0b-128b-4686-9c7f-923f1652ea6f tempest-VolumesExtendTest-1879359427 None] Created volume successfully. Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Acquiring lock "cinder-ca8e6e00-c688-4492-934f-5f87fc44cf46-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Lock "cinder-ca8e6e00-c688-4492-934f-5f87fc44cf46-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Acquiring lock "cinder-quobyte-ca8e6e00-c688-4492-934f-5f87fc44cf46" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Lock "cinder-quobyte-ca8e6e00-c688-4492-934f-5f87fc44cf46" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b295152-e85e-4ade-8748-981bb2892fd4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:45 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 Sep 09 17:59:45 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Creating offline snapshot ed7a6e55-d9d8-4726-b660-bd422edc3502 of volume c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:59:45 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b04ec98-a8e8-41b5-8232-7f3cdb7d1804]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46" returned: 0 in 0.431s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:45 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46 Sep 09 17:59:45 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:45 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 Sep 09 17:59:45 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:45 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca8e6e00-c688-4492-934f-5f87fc44cf46" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Lock "cinder-quobyte-ca8e6e00-c688-4492-934f-5f87fc44cf46" released by "delete_volume" :: held 0.769s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:45 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Created reservations ['49d7d554-9d95-40ae-b174-7d5aafa124ed', 'df2776f8-5eeb-42bc-9e9a-2b0d4ce91261', '9e2e5043-e4e2-48a5-bd68-fcff4a5d8b9e', 'bdb9d21c-1119-4b09-b7d4-91b0c5fcce21'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:59:46 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970" returned: 0 in 0.406s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:46 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 1G Sep 09 17:59:46 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:46 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:59:46 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:46 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:59:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Deleted volume successfully. Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76d80a65-d74c-411c-bc32-402458aa450d tempest-VolumesCloneNegativeTest-2115523662 None] Lock "cinder-ca8e6e00-c688-4492-934f-5f87fc44cf46-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:46 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 1G" returned: 0 in 0.464s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9461936-ece0-443b-9561-de0e048cd970 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:46 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9461936-ece0-443b-9561-de0e048cd970 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 Sep 09 17:59:46 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:46 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9461936-ece0-443b-9561-de0e048cd970 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502" returned: 0 in 0.304s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:46 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 is being set with open permissions: ugo+rw Sep 09 17:59:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:46 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 Sep 09 17:59:46 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:47 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502" returned: 0 in 0.252s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:47 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.info Sep 09 17:59:47 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:47 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.info" returned: 0 in 0.269s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:47 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.info is being set with open permissions: ugo+rw Sep 09 17:59:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:47 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.info Sep 09 17:59:47 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:47 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.info" returned: 0 in 0.253s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1bfc5a21-f01a-40a0-ae8a-cc90a6ddad1b tempest-VolumesExtendTest-1879359427 None] Create snapshot completed successfully Sep 09 17:59:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66185cbf-014f-4ac2-979a-3d0203e48a20 tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66185cbf-014f-4ac2-979a-3d0203e48a20 tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b7453d-6b9c-41bc-b125-da711560eec9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66185cbf-014f-4ac2-979a-3d0203e48a20 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:48 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 Sep 09 17:59:48 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:49 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66185cbf-014f-4ac2-979a-3d0203e48a20 tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970" returned: 0 in 0.398s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66185cbf-014f-4ac2-979a-3d0203e48a20 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 2G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66185cbf-014f-4ac2-979a-3d0203e48a20 tempest-VolumesExtendTest-1879359427 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 2G" returned: 0 in 0.132s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66185cbf-014f-4ac2-979a-3d0203e48a20 tempest-VolumesExtendTest-1879359427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.568s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:49 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-66185cbf-014f-4ac2-979a-3d0203e48a20 tempest-VolumesExtendTest-1879359427 None] Extend volume completed successfully. Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Acquiring lock "cinder-ed7a6e55-d9d8-4726-b660-bd422edc3502-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-ed7a6e55-d9d8-4726-b660-bd422edc3502-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Acquiring lock "cinder-quobyte-c9461936-ece0-443b-9561-de0e048cd970" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-quobyte-c9461936-ece0-443b-9561-de0e048cd970" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Acquiring lock "cinder-quobyte-ed7a6e55-d9d8-4726-b660-bd422edc3502" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-quobyte-ed7a6e55-d9d8-4726-b660-bd422edc3502" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Deleting offline snapshot ed7a6e55-d9d8-4726-b660-bd422edc3502 of volume c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] snapshot_file for this snap is: volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ced969-5c21-445c-87a5-8cf502a829ea]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:50 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 Sep 09 17:59:50 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:50 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502" returned: 0 in 0.362s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9461936-ece0-443b-9561-de0e048cd970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63500c4-9993-4efe-bbd4-ec5c9871eae8]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:50 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 Sep 09 17:59:50 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:50 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970" returned: 0 in 0.410s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:50 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 Sep 09 17:59:50 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:51 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502" returned: 0 in 0.375s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:51 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502 Sep 09 17:59:51 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:51 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970.ed7a6e55-d9d8-4726-b660-bd422edc3502" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-quobyte-ed7a6e55-d9d8-4726-b660-bd422edc3502" released by "_delete_snapshot" :: held 1.502s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-quobyte-c9461936-ece0-443b-9561-de0e048cd970" released by "delete_snapshot" :: held 1.522s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:51 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Created reservations ['bb2f3502-295f-4a63-a8d5-ed5e7d40d360', '7be18204-9db2-4147-b8f1-1babd48279ed', 'd14215d5-f6f0-4edd-99dd-ef0cf963bb40', '1ca61b6a-615a-435b-87e0-5a2c1cf5c382'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:59:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Delete snapshot completed successfully. Sep 09 17:59:51 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-16df91d7-a06d-4c5f-a433-1bfc908d9b68 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-ed7a6e55-d9d8-4726-b660-bd422edc3502-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Acquiring lock "cinder-c9461936-ece0-443b-9561-de0e048cd970-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-c9461936-ece0-443b-9561-de0e048cd970-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Acquiring lock "cinder-quobyte-c9461936-ece0-443b-9561-de0e048cd970" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:59:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-quobyte-c9461936-ece0-443b-9561-de0e048cd970" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:59:52 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6141f25c-6741-445f-8702-82e6e824f0ca]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:59:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:52 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 Sep 09 17:59:52 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:52 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:52 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970 Sep 09 17:59:52 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:53 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c9461936-ece0-443b-9561-de0e048cd970" returned: 0 in 0.291s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-quobyte-c9461936-ece0-443b-9561-de0e048cd970" released by "delete_volume" :: held 0.737s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Created reservations ['a30a33d0-931d-4321-af3d-1b8fa2839204', '65b8f0c3-ff3e-4e4c-8d35-4a1da055fee2', '92a6ca6d-ef68-4aba-ab05-01caa220aaff', '4a0a6ca8-e5e4-49ba-bf5d-f2466cd66caf'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:53 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 17:59:53 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:53 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.276s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:59:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Deleted volume successfully. Sep 09 17:59:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2ab3a059-5862-4980-87fa-52b9c8d476f4 tempest-VolumesExtendTest-1879359427 None] Lock "cinder-c9461936-ece0-443b-9561-de0e048cd970-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Flow 'volume_create_manager' (40a1d101-2da7-40b0-a88d-0a2400cfe880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248e3a82-ca95-4b89-9f04-aab1d35568f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248e3a82-ca95-4b89-9f04-aab1d35568f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1206774026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7074dab-f069-4cc3-8a9c-254737d433fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b13734f25f95496193e4eab73526e2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:59:57Z,use_quota=True,user_id='54b99fa188c044b9983d70a92791347e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d67fb72-0060-4199-a0d3-dc919f856703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d67fb72-0060-4199-a0d3-dc919f856703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ee0a14-fe37-4919-b882-6c8d7e961437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ee0a14-fe37-4919-b882-6c8d7e961437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7074dab-f069-4cc3-8a9c-254737d433fd', 'volume_name': 'volume-c7074dab-f069-4cc3-8a9c-254737d433fd', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577273d0-d7fc-47cd-baf1-e6e418072d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577273d0-d7fc-47cd-baf1-e6e418072d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc709c5-91a6-4bc0-a860-cafae5f8ee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:57 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Volume c7074dab-f069-4cc3-8a9c-254737d433fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7074dab-f069-4cc3-8a9c-254737d433fd', 'volume_size': 1} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1206774026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7074dab-f069-4cc3-8a9c-254737d433fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b13734f25f95496193e4eab73526e2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:59:57Z,use_quota=True,user_id='54b99fa188c044b9983d70a92791347e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Creating volume c7074dab-f069-4cc3-8a9c-254737d433fd {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:59:57 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 17:59:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:57 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd 1073741824 Sep 09 17:59:57 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:58 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd 1073741824" returned: 0 in 0.491s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:59:58 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd Sep 09 17:59:58 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:59:58 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc709c5-91a6-4bc0-a860-cafae5f8ee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7074dab-f069-4cc3-8a9c-254737d433fd', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b6b321-d011-406c-920d-0696ab28b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:59:58 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Volume volume-c7074dab-f069-4cc3-8a9c-254737d433fd (c7074dab-f069-4cc3-8a9c-254737d433fd): created successfully Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b6b321-d011-406c-920d-0696ab28b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:59:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Flow 'volume_create_manager' (40a1d101-2da7-40b0-a88d-0a2400cfe880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:59:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6625948f-d86b-4e64-a98a-9b757db4b54f tempest-VolumesListTestJSON-2048909503 None] Created volume successfully. Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Flow 'volume_create_manager' (265ff503-0150-4d36-95c8-8c3efd5d032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385ac9f2-32b8-461c-992c-158a228ed4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385ac9f2-32b8-461c-992c-158a228ed4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1847781799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1a1629-1124-4c3b-9dcc-669b96e6a3e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b13734f25f95496193e4eab73526e2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:00Z,use_quota=True,user_id='54b99fa188c044b9983d70a92791347e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6aa8713-d3a8-4a49-9b16-32407d3fa09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6aa8713-d3a8-4a49-9b16-32407d3fa09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7067680-8cf9-4ed5-a409-d52a086b7cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7067680-8cf9-4ed5-a409-d52a086b7cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1a1629-1124-4c3b-9dcc-669b96e6a3e5', 'volume_name': 'volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe20f48c-6072-4e8e-889b-1b0863863ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe20f48c-6072-4e8e-889b-1b0863863ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231a99fe-05b2-4714-83a5-51d3f0e52425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Volume dc1a1629-1124-4c3b-9dcc-669b96e6a3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5', 'volume_size': 1} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1847781799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1a1629-1124-4c3b-9dcc-669b96e6a3e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b13734f25f95496193e4eab73526e2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:00Z,use_quota=True,user_id='54b99fa188c044b9983d70a92791347e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Creating volume dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:00:00 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:00 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 1073741824 Sep 09 18:00:00 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:00 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 1073741824" returned: 0 in 0.458s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:00 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 Sep 09 18:00:00 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (c3e4186e-942d-474f-91f4-a6c875d8b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fb93a2-9ffd-49fe-bcef-86a5ac986fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fb93a2-9ffd-49fe-bcef-86a5ac986fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1932706711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37595a1c-4964-4eb5-b046-3dad719b77ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef072741fdc4bd6a50727036f18abfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:01Z,use_quota=True,user_id='5dfe15e91c584bee82a3b86fa85b9797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d144674c-8d39-4d9a-8335-b1af49a7404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d144674c-8d39-4d9a-8335-b1af49a7404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52792fff-ebb8-420b-8344-9775f621033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52792fff-ebb8-420b-8344-9775f621033f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37595a1c-4964-4eb5-b046-3dad719b77ba', 'volume_name': 'volume-37595a1c-4964-4eb5-b046-3dad719b77ba', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdcab88-0db1-47fe-b3b2-49d533836aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdcab88-0db1-47fe-b3b2-49d533836aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7f0d3a-a817-4d66-bc14-b43425f55f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume 37595a1c-4964-4eb5-b046-3dad719b77ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37595a1c-4964-4eb5-b046-3dad719b77ba', 'volume_size': 1} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:00 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1932706711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37595a1c-4964-4eb5-b046-3dad719b77ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef072741fdc4bd6a50727036f18abfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:01Z,use_quota=True,user_id='5dfe15e91c584bee82a3b86fa85b9797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Creating volume 37595a1c-4964-4eb5-b046-3dad719b77ba {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:00:00 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231a99fe-05b2-4714-83a5-51d3f0e52425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba 1073741824 Sep 09 18:00:00 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ff2e3a-1273-499f-b333-1b16b4b1a060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Volume volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 (dc1a1629-1124-4c3b-9dcc-669b96e6a3e5): created successfully Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ff2e3a-1273-499f-b333-1b16b4b1a060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Flow 'volume_create_manager' (265ff503-0150-4d36-95c8-8c3efd5d032f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f93d1d6e-9bfa-43dd-bf21-0e96669a6b2e tempest-VolumesListTestJSON-2048909503 None] Created volume successfully. Sep 09 18:00:01 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba 1073741824" returned: 0 in 0.407s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:01 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba Sep 09 18:00:01 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Flow 'volume_create_manager' (02ddea75-a435-4e56-ae58-1b54f9d7a31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:01 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2537dbaa-06da-4e21-a67a-e1d719fe72ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba" returned: 0 in 0.280s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2537dbaa-06da-4e21-a67a-e1d719fe72ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1881151923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0021a94-45f4-4b74-80b7-6967bacc88fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b13734f25f95496193e4eab73526e2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:02Z,use_quota=True,user_id='54b99fa188c044b9983d70a92791347e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be04ba3-2493-477e-8835-15d3160fa853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be04ba3-2493-477e-8835-15d3160fa853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29e0b3f-d02e-4343-9e49-050aeaf5f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29e0b3f-d02e-4343-9e49-050aeaf5f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0021a94-45f4-4b74-80b7-6967bacc88fc', 'volume_name': 'volume-c0021a94-45f4-4b74-80b7-6967bacc88fc', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf70c3e8-926f-47d1-9789-ea8a90a754fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf70c3e8-926f-47d1-9789-ea8a90a754fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed337108-5b8c-4859-a045-138564365499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:01 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Volume c0021a94-45f4-4b74-80b7-6967bacc88fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0021a94-45f4-4b74-80b7-6967bacc88fc', 'volume_size': 1} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1881151923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0021a94-45f4-4b74-80b7-6967bacc88fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b13734f25f95496193e4eab73526e2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:02Z,use_quota=True,user_id='54b99fa188c044b9983d70a92791347e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Creating volume c0021a94-45f4-4b74-80b7-6967bacc88fc {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:00:01 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7f0d3a-a817-4d66-bc14-b43425f55f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37595a1c-4964-4eb5-b046-3dad719b77ba', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc63d32-f60f-4481-8677-167234811845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:01 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc 1073741824 Sep 09 18:00:01 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:01 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume volume-37595a1c-4964-4eb5-b046-3dad719b77ba (37595a1c-4964-4eb5-b046-3dad719b77ba): created successfully Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc63d32-f60f-4481-8677-167234811845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (c3e4186e-942d-474f-91f4-a6c875d8b890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-466f8854-f70c-400b-bcf5-fe48e0797bb2 tempest-VolumesSnapshotTestJSON-2063783451 None] Created volume successfully. Sep 09 18:00:02 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc 1073741824" returned: 0 in 0.456s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:02 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc Sep 09 18:00:02 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:02 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc" returned: 0 in 0.232s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed337108-5b8c-4859-a045-138564365499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0021a94-45f4-4b74-80b7-6967bacc88fc', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2469f18-ceeb-42d8-9006-edd8798e47c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:02 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Volume volume-c0021a94-45f4-4b74-80b7-6967bacc88fc (c0021a94-45f4-4b74-80b7-6967bacc88fc): created successfully Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2469f18-ceeb-42d8-9006-edd8798e47c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Flow 'volume_create_manager' (02ddea75-a435-4e56-ae58-1b54f9d7a31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-867d478c-9c9a-4b51-b9ae-39e1a163b045 tempest-VolumesListTestJSON-2048909503 None] Created volume successfully. Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Creating offline snapshot 69707a65-9607-4391-807a-c8a89b59ec6c of volume 37595a1c-4964-4eb5-b046-3dad719b77ba {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f2679d-74ea-496d-96d6-b249fdb672b1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:03 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba Sep 09 18:00:03 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:03 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba" returned: 0 in 0.366s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:03 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c 1G Sep 09 18:00:03 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:03 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c 1G" returned: 0 in 0.468s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37595a1c-4964-4eb5-b046-3dad719b77ba -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:03 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37595a1c-4964-4eb5-b046-3dad719b77ba -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c Sep 09 18:00:04 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:04 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37595a1c-4964-4eb5-b046-3dad719b77ba -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c" returned: 0 in 0.302s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:04 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c is being set with open permissions: ugo+rw Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:04 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c Sep 09 18:00:04 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:04 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "cinder-c0021a94-45f4-4b74-80b7-6967bacc88fc-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-c0021a94-45f4-4b74-80b7-6967bacc88fc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:04 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.info Sep 09 18:00:04 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "cinder-quobyte-c0021a94-45f4-4b74-80b7-6967bacc88fc" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-quobyte-c0021a94-45f4-4b74-80b7-6967bacc88fc" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d3f352-631a-4678-8759-2caab13a7590]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:04 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc Sep 09 18:00:04 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:04 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.info" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:04 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.info is being set with open permissions: ugo+rw Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:04 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.info Sep 09 18:00:04 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:04 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:05 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc" returned: 0 in 0.358s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:05 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:05 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:05 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc Sep 09 18:00:05 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:05 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.info" returned: 0 in 0.241s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-59e88f90-fbaf-4f4c-b34c-c2934cf2757d tempest-VolumesSnapshotTestJSON-2063783451 None] Create snapshot completed successfully Sep 09 18:00:05 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.257s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:00:05 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0021a94-45f4-4b74-80b7-6967bacc88fc" returned: 0 in 0.266s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-quobyte-c0021a94-45f4-4b74-80b7-6967bacc88fc" released by "delete_volume" :: held 0.666s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Created reservations ['f771b455-7b29-405a-a064-42ce53f481c6', '02e2436c-3274-4555-8315-135d09e5aab1', '8d38f2c1-2191-416d-a06e-a486beeeb03c', '6ed8d182-28f1-414a-b297-a57bd62f0a5b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-69707a65-9607-4391-807a-c8a89b59ec6c-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-69707a65-9607-4391-807a-c8a89b59ec6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-37595a1c-4964-4eb5-b046-3dad719b77ba" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:05 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:05 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-37595a1c-4964-4eb5-b046-3dad719b77ba" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-69707a65-9607-4391-807a-c8a89b59ec6c" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-69707a65-9607-4391-807a-c8a89b59ec6c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Deleting offline snapshot 69707a65-9607-4391-807a-c8a89b59ec6c of volume 37595a1c-4964-4eb5-b046-3dad719b77ba {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] snapshot_file for this snap is: volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2331ebed-e98f-40fe-be50-4dfe80cc0dc2]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:05 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c Sep 09 18:00:05 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:05 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Deleted volume successfully. Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3eb1d3a-5a96-4dcb-99ac-29acb015099c tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-c0021a94-45f4-4b74-80b7-6967bacc88fc-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "cinder-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "cinder-quobyte-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-quobyte-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a766fa9-e354-4c4e-a1ab-e6abd19ec258]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:05 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c" returned: 0 in 0.401s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37595a1c-4964-4eb5-b046-3dad719b77ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f767e1-23d6-4ffd-9703-13781cc1e02b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:05 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 Sep 09 18:00:05 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:06 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba Sep 09 18:00:06 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:06 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5" returned: 0 in 0.359s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:06 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5 Sep 09 18:00:06 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:06 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba" returned: 0 in 0.338s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:06 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c Sep 09 18:00:06 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:06 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-quobyte-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5" released by "delete_volume" :: held 0.649s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Created reservations ['4d9598f6-a17f-48f3-b5ec-770ebe981b31', 'a4252df2-5dd1-4e8f-bb51-a524d082b18b', 'b3be733c-db23-43c9-ba9c-92adbf68350d', '92c666be-1de7-4d10-b3b0-e3a8f45ecf89'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:06 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:06 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:06 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:06 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c Sep 09 18:00:06 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:06 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:06 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Deleted volume successfully. Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3c865f70-7772-46b1-8b3b-aa6fcfabaae4 tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-dc1a1629-1124-4c3b-9dcc-669b96e6a3e5-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:06 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba.69707a65-9607-4391-807a-c8a89b59ec6c" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-69707a65-9607-4391-807a-c8a89b59ec6c" released by "_delete_snapshot" :: held 1.451s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-37595a1c-4964-4eb5-b046-3dad719b77ba" released by "delete_snapshot" :: held 1.470s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "cinder-c7074dab-f069-4cc3-8a9c-254737d433fd-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Created reservations ['f42237cf-c02b-48cd-8d67-fe8cab11e2f6', 'e88eeeb0-aefd-4b5a-b1e9-999c31bb19f9', 'e01ee07a-5073-4da6-abe6-e4dbfdb0d914', 'e1c20e1b-7352-4e35-a564-1beb463a0ede'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-c7074dab-f069-4cc3-8a9c-254737d433fd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "cinder-quobyte-c7074dab-f069-4cc3-8a9c-254737d433fd" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-quobyte-c7074dab-f069-4cc3-8a9c-254737d433fd" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:07 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Delete snapshot completed successfully. Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2c8126a4-de70-4a10-892d-2258e9a9e015 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-69707a65-9607-4391-807a-c8a89b59ec6c-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6ada92-8148-4a82-a07b-9803ebce6f68]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:07 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd Sep 09 18:00:07 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:07 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd" returned: 0 in 0.345s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:07 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd Sep 09 18:00:07 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:07 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c7074dab-f069-4cc3-8a9c-254737d433fd" returned: 0 in 0.241s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-quobyte-c7074dab-f069-4cc3-8a9c-254737d433fd" released by "delete_volume" :: held 0.626s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Created reservations ['470c9b95-99bb-47e7-a07f-d995f476f78a', 'c529b5b6-573b-44f9-9442-353aa3433a93', 'd552be4b-330e-485d-b2e0-109349c9968c', '8b8b8c0f-2235-4f96-b0b7-d537bde799c4'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:07 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:07 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (403e78c5-fe4d-4a64-9912-4bd6359a5146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d476f46-ff79-4bfd-907b-c5e54659fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d476f46-ff79-4bfd-907b-c5e54659fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-329446085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef072741fdc4bd6a50727036f18abfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:08Z,use_quota=True,user_id='5dfe15e91c584bee82a3b86fa85b9797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dad9e5-4e3c-4fd9-810a-a316d3d6d5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dad9e5-4e3c-4fd9-810a-a316d3d6d5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d6461a-7428-4459-9790-10f8732c1969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:08 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d6461a-7428-4459-9790-10f8732c1969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf', 'volume_name': 'volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fce61b-6f69-491f-8ee0-b867956a39d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5fce61b-6f69-491f-8ee0-b867956a39d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd1694a-e6d8-414a-adcb-065e9112ef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:08 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf', 'volume_size': 1} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-329446085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef072741fdc4bd6a50727036f18abfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:08Z,use_quota=True,user_id='5dfe15e91c584bee82a3b86fa85b9797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Creating volume c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:00:08 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.302s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:08 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Deleted volume successfully. Sep 09 18:00:08 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf 1073741824 Sep 09 18:00:08 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b3149844-d441-4170-b5e6-ecf798da6814 tempest-VolumesListTestJSON-2048909503 None] Lock "cinder-c7074dab-f069-4cc3-8a9c-254737d433fd-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:08 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf 1073741824" returned: 0 in 0.451s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:08 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf Sep 09 18:00:08 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:08 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd1694a-e6d8-414a-adcb-065e9112ef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953add3c-64cb-4b9d-998f-d9bea411ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:08 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf (c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf): created successfully Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953add3c-64cb-4b9d-998f-d9bea411ec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (403e78c5-fe4d-4a64-9912-4bd6359a5146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:08 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9b04bc5b-23d7-4e80-bc10-8bb1c452d3f2 tempest-VolumesSnapshotTestJSON-2063783451 None] Created volume successfully. Sep 09 18:00:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Creating offline snapshot 92be5c3e-41dd-438b-8966-889b32d08ea5 of volume c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:00:09 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d3999c-57dc-48d6-b61c-382e0739224d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:09 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf Sep 09 18:00:09 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:09 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" returned: 0 in 0.364s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:09 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 1G Sep 09 18:00:09 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:10 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 1G" returned: 0 in 0.436s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:10 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 Sep 09 18:00:10 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:10 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5" returned: 0 in 0.303s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:10 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 is being set with open permissions: ugo+rw Sep 09 18:00:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:10 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 Sep 09 18:00:10 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:10 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5" returned: 0 in 0.254s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:10 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.info Sep 09 18:00:10 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:10 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.info" returned: 0 in 0.250s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:10 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.info is being set with open permissions: ugo+rw Sep 09 18:00:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:10 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.info Sep 09 18:00:10 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:11 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.info" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bc5f81aa-c521-41dc-9426-29572bd1389e tempest-VolumesSnapshotTestJSON-2063783451 None] Create snapshot completed successfully Sep 09 18:00:11 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:00:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Flow 'volume_create_manager' (32f8bf7c-a5c5-46d7-9758-6a0fea6c2452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adaf8fe-4984-4faf-a207-d191b08955cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adaf8fe-4984-4faf-a207-d191b08955cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1576097754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d885701-f042-480d-a293-95a80f291310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876d09f85e04c12b45cb14694c1ffec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:12Z,use_quota=True,user_id='bc9bf8f7c96c42c08e491d10b9ff9434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9290d358-459e-402e-9098-4eab54922a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9290d358-459e-402e-9098-4eab54922a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f618125d-506a-4c97-ab6d-a350d3b79cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f618125d-506a-4c97-ab6d-a350d3b79cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d885701-f042-480d-a293-95a80f291310', 'volume_name': 'volume-7d885701-f042-480d-a293-95a80f291310', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253cae86-d0f7-417d-a09f-71a1e0889a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253cae86-d0f7-417d-a09f-71a1e0889a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c855d5e-74a7-4107-bdd7-3b31ad24c04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Volume 7d885701-f042-480d-a293-95a80f291310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d885701-f042-480d-a293-95a80f291310', 'volume_size': 1} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1576097754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d885701-f042-480d-a293-95a80f291310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876d09f85e04c12b45cb14694c1ffec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:12Z,use_quota=True,user_id='bc9bf8f7c96c42c08e491d10b9ff9434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Creating volume 7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:00:12 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:12 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 1073741824 Sep 09 18:00:12 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (bd96f31c-e22f-4d43-bfca-56e17f3a01a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7009ac45-0579-4ce5-b9ef-832aea830220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7009ac45-0579-4ce5-b9ef-832aea830220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1982836554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632c493e-4719-4138-9f66-d12516f0d05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef072741fdc4bd6a50727036f18abfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=92be5c3e-41dd-438b-8966-889b32d08ea5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:12Z,use_quota=True,user_id='5dfe15e91c584bee82a3b86fa85b9797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf1d7c9-a06b-4cff-beaf-e695ad2c3bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf1d7c9-a06b-4cff-beaf-e695ad2c3bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a547d151-9fca-4674-9fe8-adff10db734e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a547d151-9fca-4674-9fe8-adff10db734e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '632c493e-4719-4138-9f66-d12516f0d05e', 'volume_name': 'volume-632c493e-4719-4138-9f66-d12516f0d05e', 'volume_size': 2, 'snapshot_id': '92be5c3e-41dd-438b-8966-889b32d08ea5'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c6aa1e-4b38-43a7-8ecf-77a77e453e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c6aa1e-4b38-43a7-8ecf-77a77e453e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5255f87-8cf5-46ac-8185-9dfbf4a06409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Volume 632c493e-4719-4138-9f66-d12516f0d05e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-632c493e-4719-4138-9f66-d12516f0d05e', 'volume_size': 2, 'snapshot_id': '92be5c3e-41dd-438b-8966-889b32d08ea5'} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:12 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 1073741824" returned: 0 in 0.389s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:12 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 Sep 09 18:00:12 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:12 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310" returned: 0 in 0.231s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.526s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-92be5c3e-41dd-438b-8966-889b32d08ea5-632c493e-4719-4138-9f66-d12516f0d05e" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c855d5e-74a7-4107-bdd7-3b31ad24c04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d885701-f042-480d-a293-95a80f291310', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f0e45f-b86f-4917-8f1a-d819e028beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-92be5c3e-41dd-438b-8966-889b32d08ea5-632c493e-4719-4138-9f66-d12516f0d05e" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Creating volume 632c493e-4719-4138-9f66-d12516f0d05e from snapshot 92be5c3e-41dd-438b-8966-889b32d08ea5 {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-632c493e-4719-4138-9f66-d12516f0d05e" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:12 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Volume volume-7d885701-f042-480d-a293-95a80f291310 (7d885701-f042-480d-a293-95a80f291310): created successfully Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f0e45f-b86f-4917-8f1a-d819e028beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Flow 'volume_create_manager' (32f8bf7c-a5c5-46d7-9758-6a0fea6c2452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-632c493e-4719-4138-9f66-d12516f0d05e" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] snapshot: 92be5c3e-41dd-438b-8966-889b32d08ea5, volume: 632c493e-4719-4138-9f66-d12516f0d05e, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:00:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9fac027a-cf49-43f2-ba3d-8501348fa69b tempest-VolumesSnapshotListTestJSON-154584426 None] Created volume successfully. Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d910e1b-bc70-4ab0-81b5-b2237d15ffe3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:12 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 Sep 09 18:00:12 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:13 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5" returned: 0 in 0.347s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9457d6-cc82-4927-8b08-b9627d37ad25]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:13 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf Sep 09 18:00:13 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:13 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" returned: 0 in 0.344s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:00:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:13 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e Sep 09 18:00:13 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:17 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e" returned: 0 in 3.763s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf, size 1024.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:00:17 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Converted 1024.00 MB image at 272.04 MB/s Sep 09 18:00:17 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e is being set with open permissions: ugo+rw Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:17 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e Sep 09 18:00:17 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:17 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e" returned: 0 in 0.237s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-632c493e-4719-4138-9f66-d12516f0d05e" released by "_copy_volume_from_snapshot" :: held 4.778s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=90,cinder:UPDATE=119,cinder:DELETE=14,cinder:INSERT=35 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-92be5c3e-41dd-438b-8966-889b32d08ea5-632c493e-4719-4138-9f66-d12516f0d05e" released by "_create_volume_from_snapshot" :: held 4.858s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.892s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.377s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Creating offline snapshot 9e987af9-cf2f-4499-90d2-2858b6ba1bd0 of volume 7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5255f87-8cf5-46ac-8185-9dfbf4a06409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632c493e-4719-4138-9f66-d12516f0d05e', 'volume_size': 2, 'snapshot_id': '92be5c3e-41dd-438b-8966-889b32d08ea5'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86295df8-3af6-4d62-a5b3-cc56dc1c7259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc46538-bd67-4fb4-9d18-5001ff7b6135]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:17 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Volume volume-632c493e-4719-4138-9f66-d12516f0d05e (632c493e-4719-4138-9f66-d12516f0d05e): created successfully Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86295df8-3af6-4d62-a5b3-cc56dc1c7259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (bd96f31c-e22f-4d43-bfca-56e17f3a01a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-23559a94-16e4-4664-b3ea-497dd051427f tempest-VolumesSnapshotTestJSON-2063783451 None] Created volume successfully. Sep 09 18:00:17 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 Sep 09 18:00:17 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:17 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310" returned: 0 in 0.334s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:18 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 1G Sep 09 18:00:18 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:18 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 1G" returned: 0 in 0.365s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:18 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 Sep 09 18:00:18 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-632c493e-4719-4138-9f66-d12516f0d05e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-632c493e-4719-4138-9f66-d12516f0d05e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-632c493e-4719-4138-9f66-d12516f0d05e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-632c493e-4719-4138-9f66-d12516f0d05e" acquired by "delete_volume" :: waited 0.012s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cc9d87-7528-4396-af61-fdb82e2a0d8d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:18 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0" returned: 0 in 0.287s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:18 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 is being set with open permissions: ugo+rw Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:18 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 Sep 09 18:00:18 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:18 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e Sep 09 18:00:18 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:18 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0" returned: 0 in 0.241s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:18 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.info Sep 09 18:00:18 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:18 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e" returned: 0 in 0.344s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:18 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e Sep 09 18:00:18 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:19 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.info" returned: 0 in 0.243s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:19 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.info is being set with open permissions: ugo+rw Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:19 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.info Sep 09 18:00:19 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:19 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-632c493e-4719-4138-9f66-d12516f0d05e" returned: 0 in 0.241s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-632c493e-4719-4138-9f66-d12516f0d05e" released by "delete_volume" :: held 0.620s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Created reservations ['f62a7338-d4bf-4c2c-a19c-73ea077fbbfa', '819a297c-2aec-4267-b04d-438d4457f0e2', '2bb9d531-bec4-47b3-adf4-470f1030bd98', '7e5c4779-243d-4fda-b5a0-94e95ec274ee'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:19 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:19 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:19 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.info" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-62da11cc-8f44-468c-b201-44e73701726d tempest-VolumesSnapshotListTestJSON-154584426 None] Create snapshot completed successfully Sep 09 18:00:19 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Deleted volume successfully. Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-715f8643-e9fe-40f9-a77c-e2ad511fe1bd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-632c493e-4719-4138-9f66-d12516f0d05e-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-92be5c3e-41dd-438b-8966-889b32d08ea5-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-92be5c3e-41dd-438b-8966-889b32d08ea5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-92be5c3e-41dd-438b-8966-889b32d08ea5" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-92be5c3e-41dd-438b-8966-889b32d08ea5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Deleting offline snapshot 92be5c3e-41dd-438b-8966-889b32d08ea5 of volume c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] snapshot_file for this snap is: volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c40dfa7-339f-4c02-82d7-c8bfebef466f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:19 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 Sep 09 18:00:19 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:20 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5" returned: 0 in 0.332s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef652f6-0331-4a60-aad5-ec9b4d5f3e1c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:20 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf Sep 09 18:00:20 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:20 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" returned: 0 in 0.509s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=127,cinder:UPDATE=129,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:00:20 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 Sep 09 18:00:20 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Creating offline snapshot a5681246-e614-45ab-9cde-48fa395eb3bb of volume 7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7668ca4-4f43-4ac3-93bb-36f3cf6d8d35]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:20 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 Sep 09 18:00:20 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:21 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5" returned: 0 in 0.361s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:21 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5 Sep 09 18:00:21 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:21 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0" returned: 0 in 0.374s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d885701-f042-480d-a293-95a80f291310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:21 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb 1G Sep 09 18:00:21 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:21 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf.92be5c3e-41dd-438b-8966-889b32d08ea5" returned: 0 in 0.243s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-92be5c3e-41dd-438b-8966-889b32d08ea5" released by "_delete_snapshot" :: held 1.537s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" released by "delete_snapshot" :: held 1.563s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Created reservations ['526d1a90-cc77-4be1-b712-dfdc076c5674', 'dd48b267-5e5a-48c3-b87a-3e1e5493967a', '0cf3c749-bad6-45bd-85b6-2962ac96fd93', '7998e382-3df0-4548-840e-4376610f8911'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:21 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Delete snapshot completed successfully. Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-37d9bfc9-bd96-4900-a0b2-bd342c6aa6fd tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-92be5c3e-41dd-438b-8966-889b32d08ea5-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:21 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb 1G" returned: 0 in 0.414s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:21 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb Sep 09 18:00:21 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:21 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb" returned: 0 in 0.283s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:21 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb is being set with open permissions: ugo+rw Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:21 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb Sep 09 18:00:21 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:22 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.414s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c494cbc-f01d-4365-9090-0123eb0cbc17]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7ec5f2ff-0c85-4e5b-8edc-ee92fb8aa520 tempest-VolumesSnapshotListTestJSON-154584426 None] Create snapshot completed successfully Sep 09 18:00:22 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf Sep 09 18:00:22 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:22 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" returned: 0 in 0.383s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:22 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf Sep 09 18:00:22 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:22 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" returned: 0 in 0.243s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf" released by "delete_volume" :: held 0.700s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Created reservations ['13495d3c-7c6f-4abc-b829-589108a09543', '7eafb4c0-0695-4948-8281-1b6ea81daaeb', '35a3e1f4-5c2f-4edb-a9fc-4442fe82d8fc', '5ad48de5-368f-448f-a739-dc75d60d1827'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:22 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:22 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Creating offline snapshot 1e821b6d-81e9-4db6-a251-1b51f8982483 of volume 7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[74826787-ef7a-4acf-8b2f-ebb4cb7387b0]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:23 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.265s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:23 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Deleted volume successfully. Sep 09 18:00:23 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb Sep 09 18:00:23 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-376e0b91-2ab7-4272-98c8-cc5a3f6e5d7c tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-c0e083d3-d534-4317-b6ac-f0f5bd6c7eaf-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:23 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb" returned: 0 in 0.358s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d885701-f042-480d-a293-95a80f291310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:23 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 1G Sep 09 18:00:23 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (7ef07051-4718-4dc6-a351-94d373a1180a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814ea781-ba30-4703-a582-899ecf62f1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814ea781-ba30-4703-a582-899ecf62f1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1562908928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d65ec73-ebf9-4a79-adad-9540281ed371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef072741fdc4bd6a50727036f18abfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:24Z,use_quota=True,user_id='5dfe15e91c584bee82a3b86fa85b9797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0620e1-bcb6-408f-8563-7ce88ee4ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0620e1-bcb6-408f-8563-7ce88ee4ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e64ef6-989d-46f8-81cc-4fc503f0cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e64ef6-989d-46f8-81cc-4fc503f0cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d65ec73-ebf9-4a79-adad-9540281ed371', 'volume_name': 'volume-8d65ec73-ebf9-4a79-adad-9540281ed371', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae324ad4-a546-4f4a-84bf-b526d78c55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae324ad4-a546-4f4a-84bf-b526d78c55d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0d35d1-1b74-472b-aaa1-cff34dee5331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:23 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume 8d65ec73-ebf9-4a79-adad-9540281ed371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d65ec73-ebf9-4a79-adad-9540281ed371', 'volume_size': 1} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:23 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 1G" returned: 0 in 0.459s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:23 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 Sep 09 18:00:23 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:24 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483" returned: 0 in 0.281s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:24 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 is being set with open permissions: ugo+rw Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:24 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 Sep 09 18:00:24 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:24 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483" returned: 0 in 0.223s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.433s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.660s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1562908928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d65ec73-ebf9-4a79-adad-9540281ed371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef072741fdc4bd6a50727036f18abfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:24Z,use_quota=True,user_id='5dfe15e91c584bee82a3b86fa85b9797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Creating volume 8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:00:24 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:24 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 1073741824 Sep 09 18:00:24 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b583ecd2-a001-4b8c-b2a3-514c6663588f tempest-VolumesSnapshotListTestJSON-154584426 None] Create snapshot completed successfully Sep 09 18:00:24 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 1073741824" returned: 0 in 0.386s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:24 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 Sep 09 18:00:24 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:25 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371" returned: 0 in 0.234s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.657s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0d35d1-1b74-472b-aaa1-cff34dee5331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d65ec73-ebf9-4a79-adad-9540281ed371', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd345ebc-85a3-497a-bc19-890e66c5e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:25 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume volume-8d65ec73-ebf9-4a79-adad-9540281ed371 (8d65ec73-ebf9-4a79-adad-9540281ed371): created successfully Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd345ebc-85a3-497a-bc19-890e66c5e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (7ef07051-4718-4dc6-a351-94d373a1180a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:25 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0bda6e69-0003-4fb5-9da2-bb6ac10a2b99 tempest-VolumesSnapshotTestJSON-2063783451 None] Created volume successfully. Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-1e821b6d-81e9-4db6-a251-1b51f8982483-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-1e821b6d-81e9-4db6-a251-1b51f8982483-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-quobyte-1e821b6d-81e9-4db6-a251-1b51f8982483" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-1e821b6d-81e9-4db6-a251-1b51f8982483" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Deleting offline snapshot 1e821b6d-81e9-4db6-a251-1b51f8982483 of volume 7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] snapshot_file for this snap is: volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b9c070-4e4d-4d43-a1e4-2ef2287c0147]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Creating offline snapshot 46f730af-b8ba-49e8-a7bc-4ec149b04720 of volume 8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e7ebf-0d2d-42d8-9d96-6455b6390211]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:26 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 Sep 09 18:00:26 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:26 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 Sep 09 18:00:26 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:26 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d885701-f042-480d-a293-95a80f291310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b816526c-437c-4d69-871e-8b1ddb470fa3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:26 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:26 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 1G Sep 09 18:00:26 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:26 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb Sep 09 18:00:26 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:26 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb" returned: 0 in 0.384s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d885701-f042-480d-a293-95a80f291310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:26 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 Sep 09 18:00:26 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:26 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 1G" returned: 0 in 0.387s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d65ec73-ebf9-4a79-adad-9540281ed371 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:26 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d65ec73-ebf9-4a79-adad-9540281ed371 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 Sep 09 18:00:26 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:27 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d65ec73-ebf9-4a79-adad-9540281ed371 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720" returned: 0 in 0.289s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:27 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 is being set with open permissions: ugo+rw Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:27 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 Sep 09 18:00:27 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:27 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483" returned: 0 in 0.429s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:27 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483 Sep 09 18:00:27 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:27 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:27 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.info Sep 09 18:00:27 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:27 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.1e821b6d-81e9-4db6-a251-1b51f8982483" returned: 0 in 0.285s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-1e821b6d-81e9-4db6-a251-1b51f8982483" released by "_delete_snapshot" :: held 1.547s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" released by "delete_snapshot" :: held 1.580s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Created reservations ['eabcce22-03ba-4d26-a37d-c2d23f24d125', 'e459c203-b79b-43de-897c-fc7a3f55e2ca', '721a2a73-ce81-43fb-8ccc-976049fbf2b8', '31506d76-ee8b-4a0a-ac83-ec69579fb9c8'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Delete snapshot completed successfully. Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-cb7bef3c-52a0-4074-91f1-a25f0217b325 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-1e821b6d-81e9-4db6-a251-1b51f8982483-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:27 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.info" returned: 0 in 0.311s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:27 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.info is being set with open permissions: ugo+rw Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:27 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.info Sep 09 18:00:27 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:27 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.info" returned: 0 in 0.251s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-04cd0300-edb7-45de-ba52-53571d841bf6 tempest-VolumesSnapshotTestJSON-2063783451 None] Create snapshot completed successfully Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-a5681246-e614-45ab-9cde-48fa395eb3bb-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-a5681246-e614-45ab-9cde-48fa395eb3bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-quobyte-a5681246-e614-45ab-9cde-48fa395eb3bb" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-a5681246-e614-45ab-9cde-48fa395eb3bb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Deleting offline snapshot a5681246-e614-45ab-9cde-48fa395eb3bb of volume 7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] snapshot_file for this snap is: volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46927c9-8654-4313-bdb2-592d3aa2d2bf]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:28 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb Sep 09 18:00:28 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:28 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb" returned: 0 in 0.379s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d885701-f042-480d-a293-95a80f291310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b4ac54-a053-4721-ad6b-9d2f5f451cde]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:00:28 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 Sep 09 18:00:28 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (fd0fddf9-f48e-4aa4-aab9-c64f1de87dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c36447e-f1c0-4e31-8d0a-565e6f82f94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c36447e-f1c0-4e31-8d0a-565e6f82f94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1220607706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b290709-e102-405c-a73f-8c4e63e89132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef072741fdc4bd6a50727036f18abfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46f730af-b8ba-49e8-a7bc-4ec149b04720,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:00:29Z,use_quota=True,user_id='5dfe15e91c584bee82a3b86fa85b9797',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09577afd-2d20-4dfc-b83f-377d926a88b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09577afd-2d20-4dfc-b83f-377d926a88b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c3f697-e078-4f3f-b2e3-03e1b8275d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c3f697-e078-4f3f-b2e3-03e1b8275d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b290709-e102-405c-a73f-8c4e63e89132', 'volume_name': 'volume-5b290709-e102-405c-a73f-8c4e63e89132', 'volume_size': 1, 'snapshot_id': '46f730af-b8ba-49e8-a7bc-4ec149b04720'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828394fd-acfb-4f7c-a38d-e7f10bbcd7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828394fd-acfb-4f7c-a38d-e7f10bbcd7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf5513d-e3d6-4be9-a6dd-b82f12b5b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:28 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume 5b290709-e102-405c-a73f-8c4e63e89132: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b290709-e102-405c-a73f-8c4e63e89132', 'volume_size': 1, 'snapshot_id': '46f730af-b8ba-49e8-a7bc-4ec149b04720'} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-46f730af-b8ba-49e8-a7bc-4ec149b04720-5b290709-e102-405c-a73f-8c4e63e89132" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-46f730af-b8ba-49e8-a7bc-4ec149b04720-5b290709-e102-405c-a73f-8c4e63e89132" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Creating volume 5b290709-e102-405c-a73f-8c4e63e89132 from snapshot 46f730af-b8ba-49e8-a7bc-4ec149b04720 {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-5b290709-e102-405c-a73f-8c4e63e89132" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-5b290709-e102-405c-a73f-8c4e63e89132" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] snapshot: 46f730af-b8ba-49e8-a7bc-4ec149b04720, volume: 5b290709-e102-405c-a73f-8c4e63e89132, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd3b56-137a-4f01-a0f1-1d6a9979dfa4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:28 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d885701-f042-480d-a293-95a80f291310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:28 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb Sep 09 18:00:28 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:28 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 Sep 09 18:00:28 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:29 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720" returned: 0 in 0.371s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d65ec73-ebf9-4a79-adad-9540281ed371(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa66bf-ab68-44be-9cf9-b0a58fb97665]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:29 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb" returned: 0 in 0.369s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:29 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb Sep 09 18:00:29 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:29 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 Sep 09 18:00:29 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:29 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.a5681246-e614-45ab-9cde-48fa395eb3bb" returned: 0 in 0.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:29 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-a5681246-e614-45ab-9cde-48fa395eb3bb" released by "_delete_snapshot" :: held 1.436s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371" returned: 0 in 0.341s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" released by "delete_snapshot" :: held 1.470s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:29 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 Sep 09 18:00:29 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Created reservations ['fa592948-e4ae-4171-8726-c32e212a4de3', '8d8b69ea-d54a-41e6-a848-fa5d47918558', '28699793-1b35-4add-b3ee-867668d34dc2', 'c0ace35b-2a71-4cef-9993-480a41a0fa48'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:29 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Delete snapshot completed successfully. Sep 09 18:00:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-76289237-4586-439f-8612-8fbb149a2c01 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-a5681246-e614-45ab-9cde-48fa395eb3bb-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-9e987af9-cf2f-4499-90d2-2858b6ba1bd0-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-9e987af9-cf2f-4499-90d2-2858b6ba1bd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-quobyte-9e987af9-cf2f-4499-90d2-2858b6ba1bd0" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-9e987af9-cf2f-4499-90d2-2858b6ba1bd0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Deleting offline snapshot 9e987af9-cf2f-4499-90d2-2858b6ba1bd0 of volume 7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] snapshot_file for this snap is: volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba60612-2c2f-4171-a17b-12d04cd827c7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:30 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 Sep 09 18:00:30 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:31 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0" returned: 0 in 0.695s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d885701-f042-480d-a293-95a80f291310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:31 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c840b-2fab-426d-aabc-f0073e33bc4b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:31 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 Sep 09 18:00:31 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:31 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310" returned: 0 in 0.764s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:32 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 Sep 09 18:00:32 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:32 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0" returned: 0 in 0.907s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:32 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0 Sep 09 18:00:32 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:33 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310.9e987af9-cf2f-4499-90d2-2858b6ba1bd0" returned: 0 in 0.606s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-9e987af9-cf2f-4499-90d2-2858b6ba1bd0" released by "_delete_snapshot" :: held 3.316s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" released by "delete_snapshot" :: held 3.353s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:33 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132" returned: 0 in 4.229s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:00:33 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Converted 1024.00 MB image at 242.09 MB/s Sep 09 18:00:33 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 is being set with open permissions: ugo+rw Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:33 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 Sep 09 18:00:33 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Created reservations ['63661178-aacc-4fca-b8ee-bce147a1dcbe', '41e68cd4-0d68-4170-baba-49de3ba8aa9f', 'ef789ec2-064b-48ac-8f0c-4ff24b8c2cb7', '171938b3-0ca5-449b-a168-081d33f42897'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Delete snapshot completed successfully. Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e3e48a67-d8ed-47d2-a96e-47bd38f206e1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-9e987af9-cf2f-4499-90d2-2858b6ba1bd0-delete_snapshot" released by "delete_snapshot" :: held 3.535s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:33 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132" returned: 0 in 0.240s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-5b290709-e102-405c-a73f-8c4e63e89132" released by "_copy_volume_from_snapshot" :: held 5.258s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-46f730af-b8ba-49e8-a7bc-4ec149b04720-5b290709-e102-405c-a73f-8c4e63e89132" released by "_create_volume_from_snapshot" :: held 5.315s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.330s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf5513d-e3d6-4be9-a6dd-b82f12b5b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b290709-e102-405c-a73f-8c4e63e89132', 'volume_size': 1, 'snapshot_id': '46f730af-b8ba-49e8-a7bc-4ec149b04720'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423701ee-4655-4ce9-babd-1f23ed67f1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:00:34 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Volume volume-5b290709-e102-405c-a73f-8c4e63e89132 (5b290709-e102-405c-a73f-8c4e63e89132): created successfully Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423701ee-4655-4ce9-babd-1f23ed67f1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Flow 'volume_create_manager' (fd0fddf9-f48e-4aa4-aab9-c64f1de87dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:00:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8e83e103-a4c2-4018-be73-4be3b026da51 tempest-VolumesSnapshotTestJSON-2063783451 None] Created volume successfully. Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-5b290709-e102-405c-a73f-8c4e63e89132-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-5b290709-e102-405c-a73f-8c4e63e89132-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-5b290709-e102-405c-a73f-8c4e63e89132" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-5b290709-e102-405c-a73f-8c4e63e89132" acquired by "delete_volume" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5634b3-bcf7-42b6-aa66-3a5235e64a1d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:34 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 Sep 09 18:00:34 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:34 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:34 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132 Sep 09 18:00:34 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-7d885701-f042-480d-a293-95a80f291310-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-7d885701-f042-480d-a293-95a80f291310-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" acquired by "delete_volume" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e0d57e-1f7d-4236-af92-b703b8ee2678]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:34 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5b290709-e102-405c-a73f-8c4e63e89132" returned: 0 in 0.250s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-5b290709-e102-405c-a73f-8c4e63e89132" released by "delete_volume" :: held 0.632s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:34 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 Sep 09 18:00:34 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:34 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Created reservations ['12da208f-d395-4b71-880b-13a9fa973ae8', 'f2370bc3-3b55-49fe-818c-bfafded7ac4a', 'ad5e849f-6874-4934-a0ec-c2b33501e684', 'db137bc7-e7cb-47a8-b013-4a98a86d3867'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:35 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:35 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:35 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:35 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310 Sep 09 18:00:35 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:35 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.257s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Deleted volume successfully. Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bbfe0e89-5213-4f4c-a2ec-d168e7be0901 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-5b290709-e102-405c-a73f-8c4e63e89132-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:35 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7d885701-f042-480d-a293-95a80f291310" returned: 0 in 0.237s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-46f730af-b8ba-49e8-a7bc-4ec149b04720-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-quobyte-7d885701-f042-480d-a293-95a80f291310" released by "delete_volume" :: held 0.666s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-46f730af-b8ba-49e8-a7bc-4ec149b04720-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-8d65ec73-ebf9-4a79-adad-9540281ed371" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-8d65ec73-ebf9-4a79-adad-9540281ed371" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-46f730af-b8ba-49e8-a7bc-4ec149b04720" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-46f730af-b8ba-49e8-a7bc-4ec149b04720" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Deleting offline snapshot 46f730af-b8ba-49e8-a7bc-4ec149b04720 of volume 8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] snapshot_file for this snap is: volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e6aa9c-d3cb-4f5b-ba1c-eeaa5da6ad6a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Created reservations ['768062be-4993-4684-8068-e8ef0e55679d', 'f9c3c1c2-9127-4a1b-936c-63112fa572eb', '2653c5d4-c574-4ece-8f71-c3883e133c53', 'a06270e5-3776-4d7e-9d9c-74adde1d7d40'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:35 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 Sep 09 18:00:35 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:35 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:35 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:35 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Deleted volume successfully. Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d15999a3-1255-49fa-9699-f0c66a422da1 tempest-VolumesSnapshotListTestJSON-154584426 None] Lock "cinder-7d885701-f042-480d-a293-95a80f291310-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:35 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720" returned: 0 in 0.405s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d65ec73-ebf9-4a79-adad-9540281ed371(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18e3902-f99d-4e34-ac53-dfa165a251b3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:36 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 Sep 09 18:00:36 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:36 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371" returned: 0 in 0.521s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:36 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 Sep 09 18:00:36 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:36 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720" returned: 0 in 0.361s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:36 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720 Sep 09 18:00:36 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:37 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371.46f730af-b8ba-49e8-a7bc-4ec149b04720" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-46f730af-b8ba-49e8-a7bc-4ec149b04720" released by "_delete_snapshot" :: held 1.645s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-8d65ec73-ebf9-4a79-adad-9540281ed371" released by "delete_snapshot" :: held 1.669s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Created reservations ['f0c0ff74-f021-4e8e-a36d-845bf8537ffc', 'd866b4b6-998a-4f22-b108-a0198e5e19ba', '3810388f-59d8-44f7-80ab-b126438bb3ef', '606bdb62-160d-4d5c-882f-53a2a9b5ddc4'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Delete snapshot completed successfully. Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-3d406ff7-51e7-48e6-8a15-6d8e0a11d9ad tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-46f730af-b8ba-49e8-a7bc-4ec149b04720-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-8d65ec73-ebf9-4a79-adad-9540281ed371-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-8d65ec73-ebf9-4a79-adad-9540281ed371-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-8d65ec73-ebf9-4a79-adad-9540281ed371" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-8d65ec73-ebf9-4a79-adad-9540281ed371" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce39135-2243-4883-ac57-f2ced3757798]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:37 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 Sep 09 18:00:37 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:38 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:38 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371 Sep 09 18:00:38 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:38 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-8d65ec73-ebf9-4a79-adad-9540281ed371" returned: 0 in 0.241s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-8d65ec73-ebf9-4a79-adad-9540281ed371" released by "delete_volume" :: held 0.665s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Created reservations ['2377314f-16c1-4eb8-b542-7ed4eec1c64f', 'b4070017-1e10-4c2a-b5f1-26cf30915500', '7fab095c-c6e4-4d6f-b94d-bd09855b3d8f', '06527555-9631-496c-8003-d51a32b959e7'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:38 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:38 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:38 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.282s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Deleted volume successfully. Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b4fd8306-40a1-4e5b-9ae5-ad20af70e19a tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-8d65ec73-ebf9-4a79-adad-9540281ed371-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-37595a1c-4964-4eb5-b046-3dad719b77ba-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-37595a1c-4964-4eb5-b046-3dad719b77ba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "cinder-quobyte-37595a1c-4964-4eb5-b046-3dad719b77ba" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-37595a1c-4964-4eb5-b046-3dad719b77ba" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[074eef5a-a48f-4f71-80c4-e49dfdf89425]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:39 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba Sep 09 18:00:39 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:39 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba" returned: 0 in 0.405s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:39 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba Sep 09 18:00:39 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:39 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-37595a1c-4964-4eb5-b046-3dad719b77ba" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-quobyte-37595a1c-4964-4eb5-b046-3dad719b77ba" released by "delete_volume" :: held 0.726s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Created reservations ['a49172f4-dd18-4203-9289-0733033c91e7', '01d50f68-b14a-4224-8c3e-887da7f0da49', 'adabe233-43d6-47f5-9206-9a772b8ba4c0', '92427b99-6fad-4426-8bfb-96eebf65f5e4'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:00:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:00:39 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:00:39 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:00:40 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 09 18:00:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.254s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:00:40 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:00:40 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Deleted volume successfully. Sep 09 18:00:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a51b202-da7c-4de4-9ec7-40a13dd64048 tempest-VolumesSnapshotTestJSON-2063783451 None] Lock "cinder-37595a1c-4964-4eb5-b046-3dad719b77ba-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:00:49 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=91,cinder:DELETE=8,cinder:SELECT=72,cinder:INSERT=21 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:00:50 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=64,cinder:INSERT=25,cinder:UPDATE=75,cinder:DELETE=4 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:05 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:01:05 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:05 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.323s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:01:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Flow 'volume_create_manager' (e67d54f8-9116-473d-955e-123a5d5ea3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0106f1b5-0a7c-47a1-a6b8-281f64b14aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0106f1b5-0a7c-47a1-a6b8-281f64b14aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1299053633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e46beb-a585-4dfe-86bc-fcb787cbacd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382a591ba3a24dd1b4dc943db7bced17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:01:12Z,use_quota=True,user_id='fd3bbf781fbc43e5b36d3fb96c60d832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d34054-42e9-4d88-8442-94905c0f4ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d34054-42e9-4d88-8442-94905c0f4ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a911d9-9e87-40bb-bec7-ec7a13b071b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a911d9-9e87-40bb-bec7-ec7a13b071b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e46beb-a585-4dfe-86bc-fcb787cbacd7', 'volume_name': 'volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f2b93d-54c6-4faf-97eb-246bf65fa9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f2b93d-54c6-4faf-97eb-246bf65fa9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af73b5e-f757-4dc1-8f8f-126f0d5b887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:11 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Volume e1e46beb-a585-4dfe-86bc-fcb787cbacd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7', 'volume_size': 1} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1299053633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e46beb-a585-4dfe-86bc-fcb787cbacd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382a591ba3a24dd1b4dc943db7bced17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:01:12Z,use_quota=True,user_id='fd3bbf781fbc43e5b36d3fb96c60d832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Creating volume e1e46beb-a585-4dfe-86bc-fcb787cbacd7 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:01:12 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:12 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 1073741824 Sep 09 18:01:12 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:12 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 1073741824" returned: 0 in 0.487s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:12 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 Sep 09 18:01:12 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:12 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7" returned: 0 in 0.253s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af73b5e-f757-4dc1-8f8f-126f0d5b887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc3d05d-118c-488f-8f65-cc63e4c5832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:12 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Volume volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 (e1e46beb-a585-4dfe-86bc-fcb787cbacd7): created successfully Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc3d05d-118c-488f-8f65-cc63e4c5832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Flow 'volume_create_manager' (e67d54f8-9116-473d-955e-123a5d5ea3fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:01:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a5478f00-8470-4de5-b0d0-ed55c4263753 tempest-TestMinimumBasicScenario-811273006 None] Created volume successfully. Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Flow 'volume_create_manager' (1cd9df3a-7a10-4dad-a195-ecadf65158f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b52c38c-798c-45a4-a2f9-423412f6a71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b52c38c-798c-45a4-a2f9-423412f6a71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-980722032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c5b9e2-6645-4e9e-aeb7-40e17b276994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dda6a48b6ba4048b2185fc452a040bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:01:14Z,use_quota=True,user_id='5f2cb18a53544e2c9dd09f81c871a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f433eb04-e5d0-4807-a5fd-bfca6bc7d9fa),volume_type_id=f433eb04-e5d0-4807-a5fd-bfca6bc7d9fa)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbaa1f9-df05-46b8-9e22-eaf142349fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbaa1f9-df05-46b8-9e22-eaf142349fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8fbcc6-6efe-427b-acfe-00cf7b625ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8fbcc6-6efe-427b-acfe-00cf7b625ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c5b9e2-6645-4e9e-aeb7-40e17b276994', 'volume_name': 'volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f4c9ef-294c-4660-958c-0fe286e60141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f4c9ef-294c-4660-958c-0fe286e60141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54714d2-e585-42af-a712-f474ce861251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume d1c5b9e2-6645-4e9e-aeb7-40e17b276994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994', 'volume_size': 1} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-980722032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c5b9e2-6645-4e9e-aeb7-40e17b276994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dda6a48b6ba4048b2185fc452a040bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:01:14Z,use_quota=True,user_id='5f2cb18a53544e2c9dd09f81c871a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f433eb04-e5d0-4807-a5fd-bfca6bc7d9fa),volume_type_id=f433eb04-e5d0-4807-a5fd-bfca6bc7d9fa)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Creating volume d1c5b9e2-6645-4e9e-aeb7-40e17b276994 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:01:14 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:01:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:14 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 1073741824 Sep 09 18:01:14 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Flow 'volume_create_manager' (efe8b0be-69fa-4dca-960c-e4d44d551c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b893b1-8ada-4dd8-8b65-dfd54c968772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b893b1-8ada-4dd8-8b65-dfd54c968772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-59788462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dda6a48b6ba4048b2185fc452a040bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:01:15Z,use_quota=True,user_id='5f2cb18a53544e2c9dd09f81c871a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8080b76c-4e27-4576-b596-12f95e3c8085),volume_type_id=8080b76c-4e27-4576-b596-12f95e3c8085)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1914e4-a4ee-4d2d-8d71-05bafc6e7f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1914e4-a4ee-4d2d-8d71-05bafc6e7f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545e9b8a-3f99-4db5-959c-910bd46bd3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545e9b8a-3f99-4db5-959c-910bd46bd3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19', 'volume_name': 'volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc51b21-ee44-486d-9564-6d8ffa6f2fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc51b21-ee44-486d-9564-6d8ffa6f2fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3216ee-176a-4cf9-aed0-64e4fbd0df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume 3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19', 'volume_size': 1} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:15 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 1073741824" returned: 0 in 0.834s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:15 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 Sep 09 18:01:15 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-00e3ff7d-32a3-41b4-b962-aac48731be40 req-ec7f7c1b-f743-4cf6-9d89-f2d345f29a0e tempest-TestMinimumBasicScenario-811273006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Flow 'volume_create_manager' (39220b5e-1f1b-4825-8cfd-9f83517cfab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1236a4d-2ed8-414b-9609-e41bfb221b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1236a4d-2ed8-414b-9609-e41bfb221b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-449327663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01df03e2-1d74-4f18-a290-8e98d57536cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dda6a48b6ba4048b2185fc452a040bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:01:16Z,use_quota=True,user_id='5f2cb18a53544e2c9dd09f81c871a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5b28aaa-5d86-45f9-be61-6439cbee7d96),volume_type_id=b5b28aaa-5d86-45f9-be61-6439cbee7d96)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bbd809-bd5f-4142-9e0c-5b04d4359a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bbd809-bd5f-4142-9e0c-5b04d4359a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998c46ba-b104-4a93-9f22-da89a0f01ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:01:15 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994" returned: 0 in 0.293s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-59788462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dda6a48b6ba4048b2185fc452a040bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:01:15Z,use_quota=True,user_id='5f2cb18a53544e2c9dd09f81c871a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8080b76c-4e27-4576-b596-12f95e3c8085),volume_type_id=8080b76c-4e27-4576-b596-12f95e3c8085)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Creating volume 3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:01:15 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54714d2-e585-42af-a712-f474ce861251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f44a02b-d0ee-4332-9ff4-f9bedb91a43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:15 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 1073741824 Sep 09 18:01:15 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:15 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 (d1c5b9e2-6645-4e9e-aeb7-40e17b276994): created successfully Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f44a02b-d0ee-4332-9ff4-f9bedb91a43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Flow 'volume_create_manager' (1cd9df3a-7a10-4dad-a195-ecadf65158f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:01:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-38121ea0-cb11-4fb0-a92f-ad06fb229b1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Created volume successfully. Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998c46ba-b104-4a93-9f22-da89a0f01ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01df03e2-1d74-4f18-a290-8e98d57536cb', 'volume_name': 'volume-01df03e2-1d74-4f18-a290-8e98d57536cb', 'volume_size': 1, 'image_id': '74582603-8d81-4456-928d-0cf3ad3bf88c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74582603-8d81-4456-928d-0cf3ad3bf88c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--520749051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7dda6a48b6ba4048b2185fc452a040bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74582603-8d81-4456-928d-0cf3ad3bf88c', 'created_at': datetime.datetime(2026, 9, 9, 16, 1, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 1, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74582603-8d81-4456-928d-0cf3ad3bf88c/file', 'properties': {}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5b7397-76ad-45f9-8a35-51c6f7a69c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5b7397-76ad-45f9-8a35-51c6f7a69c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024ca11f-61f3-434d-b8dd-5f58d9f3873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:16 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume 01df03e2-1d74-4f18-a290-8e98d57536cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01df03e2-1d74-4f18-a290-8e98d57536cb', 'volume_size': 1, 'image_id': '74582603-8d81-4456-928d-0cf3ad3bf88c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74582603-8d81-4456-928d-0cf3ad3bf88c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--520749051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7dda6a48b6ba4048b2185fc452a040bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74582603-8d81-4456-928d-0cf3ad3bf88c', 'created_at': datetime.datetime(2026, 9, 9, 16, 1, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 1, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74582603-8d81-4456-928d-0cf3ad3bf88c/file', 'properties': {}}, 'image_service': } Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Trying to clone 01df03e2-1d74-4f18-a290-8e98d57536cb from image 74582603-8d81-4456-928d-0cf3ad3bf88c at location (None, [{'url': 'file:///opt/stack/data/glance/images/74582603-8d81-4456-928d-0cf3ad3bf88c', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:01:16 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 1073741824" returned: 0 in 0.522s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:16 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 Sep 09 18:01:16 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:16 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-00e3ff7d-32a3-41b4-b962-aac48731be40 req-ec7f7c1b-f743-4cf6-9d89-f2d345f29a0e tempest-TestMinimumBasicScenario-811273006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.950s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-00e3ff7d-32a3-41b4-b962-aac48731be40 req-ec7f7c1b-f743-4cf6-9d89-f2d345f29a0e tempest-TestMinimumBasicScenario-811273006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3216ee-176a-4cf9-aed0-64e4fbd0df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8868a483-6d78-48be-ba8e-143fdddb153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:16 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 (3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19): created successfully Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8868a483-6d78-48be-ba8e-143fdddb153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Flow 'volume_create_manager' (efe8b0be-69fa-4dca-960c-e4d44d551c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:01:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-00e3ff7d-32a3-41b4-b962-aac48731be40 req-ec7f7c1b-f743-4cf6-9d89-f2d345f29a0e tempest-TestMinimumBasicScenario-811273006 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '408027f6-7c1b-48a8-87b6-1983dd1648b5', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:01:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b945bbbb-7237-4357-a9ef-ed9ea2d4b34d tempest-TestInstancesWithCinderVolumes-1172192216 None] Created volume successfully. Sep 09 18:01:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-00e3ff7d-32a3-41b4-b962-aac48731be40 req-ec7f7c1b-f743-4cf6-9d89-f2d345f29a0e tempest-TestMinimumBasicScenario-811273006 None] attachment_update completed successfully. Sep 09 18:01:19 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD, size 20.69 MB, duration 3.56 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:01:19 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Image download 20.69 MB at 5.81 MB/s Sep 09 18:01:19 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[187f5113-bab8-4037-b776-a2c1c916a54e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:01:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:19 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD Sep 09 18:01:19 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:20 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Temporary image 74582603-8d81-4456-928d-0cf3ad3bf88c is fetched for user 5f2cb18a53544e2c9dd09f81c871a256. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c25ef0-de8f-43b9-978e-dd90f0b51f77]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:20 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD Sep 09 18:01:20 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:20 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-449327663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01df03e2-1d74-4f18-a290-8e98d57536cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dda6a48b6ba4048b2185fc452a040bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:01:16Z,use_quota=True,user_id='5f2cb18a53544e2c9dd09f81c871a256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5b28aaa-5d86-45f9-be61-6439cbee7d96),volume_type_id=b5b28aaa-5d86-45f9-be61-6439cbee7d96)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Creating volume 01df03e2-1d74-4f18-a290-8e98d57536cb {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:01:20 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:20 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb 1073741824 Sep 09 18:01:20 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:20 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb 1073741824" returned: 0 in 0.462s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:21 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb Sep 09 18:01:21 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:21 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb" returned: 0 in 0.313s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:01:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:21 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Attempting download of 74582603-8d81-4456-928d-0cf3ad3bf88c ((None, [{'url': 'file:///opt/stack/data/glance/images/74582603-8d81-4456-928d-0cf3ad3bf88c', 'metadata': {}}])) to volume 01df03e2-1d74-4f18-a290-8e98d57536cb. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:01:21 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24a4373-8839-44ac-94ec-eb3367a21137]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:01:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74582603-8d81-4456-928d-0cf3ad3bf88c_xr4y1bkb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:21 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74582603-8d81-4456-928d-0cf3ad3bf88c_xr4y1bkb Sep 09 18:01:21 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:21 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74582603-8d81-4456-928d-0cf3ad3bf88c_xr4y1bkb" returned: 0 in 0.417s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74582603-8d81-4456-928d-0cf3ad3bf88c_xr4y1bkb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:21 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74582603-8d81-4456-928d-0cf3ad3bf88c_xr4y1bkb Sep 09 18:01:21 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:22 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74582603-8d81-4456-928d-0cf3ad3bf88c_xr4y1bkb" returned: 1 in 0.513s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74582603-8d81-4456-928d-0cf3ad3bf88c_xr4y1bkb' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:01:22 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6914ebac-ae2c-4293-bd0a-9ddb74203bc7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:01:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:22 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD Sep 09 18:01:22 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:22 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:22 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] 74582603-8d81-4456-928d-0cf3ad3bf88c was qcow2, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:01:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:22 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb Sep 09 18:01:22 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:24 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb" returned: 0 in 1.720s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74582603-8d81-4456-928d-0cf3ad3bf88c_zir_g74kdevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:01:24 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Converted 112.00 MB image at 65.03 MB/s Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:01:24 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb 1G Sep 09 18:01:24 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:01:24 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb 1G" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Downloaded image 74582603-8d81-4456-928d-0cf3ad3bf88c ((None, [{'url': 'file:///opt/stack/data/glance/images/74582603-8d81-4456-928d-0cf3ad3bf88c', 'metadata': {}}])) to volume 01df03e2-1d74-4f18-a290-8e98d57536cb successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Temporary image 74582603-8d81-4456-928d-0cf3ad3bf88c for user 5f2cb18a53544e2c9dd09f81c871a256 is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Marking volume 01df03e2-1d74-4f18-a290-8e98d57536cb as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Copying metadata from image 74582603-8d81-4456-928d-0cf3ad3bf88c to 01df03e2-1d74-4f18-a290-8e98d57536cb. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Creating volume glance metadata for volume 01df03e2-1d74-4f18-a290-8e98d57536cb backed by image 74582603-8d81-4456-928d-0cf3ad3bf88c with: {'image_id': '74582603-8d81-4456-928d-0cf3ad3bf88c', 'image_name': 'tempest-scenario-img--520749051', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024ca11f-61f3-434d-b8dd-5f58d9f3873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01df03e2-1d74-4f18-a290-8e98d57536cb', 'volume_size': 1, 'image_id': '74582603-8d81-4456-928d-0cf3ad3bf88c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74582603-8d81-4456-928d-0cf3ad3bf88c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--520749051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7dda6a48b6ba4048b2185fc452a040bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74582603-8d81-4456-928d-0cf3ad3bf88c', 'created_at': datetime.datetime(2026, 9, 9, 16, 1, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 1, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74582603-8d81-4456-928d-0cf3ad3bf88c/file', 'properties': {}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80399d7-a2f1-4f21-a9bb-92bf4b9bb9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:01:24 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Volume volume-01df03e2-1d74-4f18-a290-8e98d57536cb (01df03e2-1d74-4f18-a290-8e98d57536cb): created successfully Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80399d7-a2f1-4f21-a9bb-92bf4b9bb9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:01:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Flow 'volume_create_manager' (39220b5e-1f1b-4825-8cfd-9f83517cfab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:01:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9320dd8c-ab6f-451b-b88a-c342d68932dd tempest-TestInstancesWithCinderVolumes-1172192216 None] Created volume successfully. Sep 09 18:01:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-4bd2dd09-fba5-427f-b152-67c78414e44e req-7e1e519d-9e25-4d9a-b4da-e2c66ddc5795 tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-4bd2dd09-fba5-427f-b152-67c78414e44e req-7e1e519d-9e25-4d9a-b4da-e2c66ddc5795 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-4bd2dd09-fba5-427f-b152-67c78414e44e req-7e1e519d-9e25-4d9a-b4da-e2c66ddc5795 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-4bd2dd09-fba5-427f-b152-67c78414e44e req-7e1e519d-9e25-4d9a-b4da-e2c66ddc5795 tempest-TestInstancesWithCinderVolumes-1172192216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-01df03e2-1d74-4f18-a290-8e98d57536cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e7bd96c-8a6d-46ca-961c-0bb2086622ba', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:01:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-4bd2dd09-fba5-427f-b152-67c78414e44e req-7e1e519d-9e25-4d9a-b4da-e2c66ddc5795 tempest-TestInstancesWithCinderVolumes-1172192216 None] attachment_update completed successfully. Sep 09 18:01:37 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=28,cinder:UPDATE=16,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:01:37 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:01:47 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:01:47 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:01:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-e77417ba-a65a-4546-bfb6-eb1a9919c911 req-2bf512d3-103c-4f3c-9352-461a36cf7761 tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:01:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-e77417ba-a65a-4546-bfb6-eb1a9919c911 req-2bf512d3-103c-4f3c-9352-461a36cf7761 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:01:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-e77417ba-a65a-4546-bfb6-eb1a9919c911 req-2bf512d3-103c-4f3c-9352-461a36cf7761 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:01:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-e77417ba-a65a-4546-bfb6-eb1a9919c911 req-2bf512d3-103c-4f3c-9352-461a36cf7761 tempest-TestInstancesWithCinderVolumes-1172192216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd9325e1-87f6-4d12-ae56-93ffd1cdd930', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:01:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-e77417ba-a65a-4546-bfb6-eb1a9919c911 req-2bf512d3-103c-4f3c-9352-461a36cf7761 tempest-TestInstancesWithCinderVolumes-1172192216 None] attachment_update completed successfully. Sep 09 18:02:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-10a13978-009d-4225-a222-f8f7cdc3a81e req-8fbac43a-197d-4548-aa22-d381156adf1d tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-10a13978-009d-4225-a222-f8f7cdc3a81e req-8fbac43a-197d-4548-aa22-d381156adf1d tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-10a13978-009d-4225-a222-f8f7cdc3a81e req-8fbac43a-197d-4548-aa22-d381156adf1d tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-10a13978-009d-4225-a222-f8f7cdc3a81e req-8fbac43a-197d-4548-aa22-d381156adf1d tempest-TestInstancesWithCinderVolumes-1172192216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c96e4f6d-59eb-412b-8eb7-4e1969764207', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:02:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-10a13978-009d-4225-a222-f8f7cdc3a81e req-8fbac43a-197d-4548-aa22-d381156adf1d tempest-TestInstancesWithCinderVolumes-1172192216 None] attachment_update completed successfully. Sep 09 18:02:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-86b928e0-1188-4da9-8416-af35e47f8c1e req-5cf84b53-9f71-4201-b612-c8d39b71ce4b tempest-TestMinimumBasicScenario-811273006 None] Terminate volume connection completed successfully. Sep 09 18:02:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-86b928e0-1188-4da9-8416-af35e47f8c1e req-5cf84b53-9f71-4201-b612-c8d39b71ce4b tempest-TestMinimumBasicScenario-811273006 None] Deleting attachment 408027f6-7c1b-48a8-87b6-1983dd1648b5. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:02:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Acquiring lock "cinder-e1e46beb-a585-4dfe-86bc-fcb787cbacd7-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:02:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Lock "cinder-e1e46beb-a585-4dfe-86bc-fcb787cbacd7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:02:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Acquiring lock "cinder-quobyte-e1e46beb-a585-4dfe-86bc-fcb787cbacd7" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:02:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Lock "cinder-quobyte-e1e46beb-a585-4dfe-86bc-fcb787cbacd7" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:02:03 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3efa5ca-bf97-4729-be6d-04b1fc786bd3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:02:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:03 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 Sep 09 18:02:03 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:03 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7" returned: 0 in 0.366s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:03 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7 Sep 09 18:02:03 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:04 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1e46beb-a585-4dfe-86bc-fcb787cbacd7" returned: 0 in 0.254s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Lock "cinder-quobyte-e1e46beb-a585-4dfe-86bc-fcb787cbacd7" released by "delete_volume" :: held 0.664s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Created reservations ['5e0ba42b-695c-46f4-ad0d-91a87dcc9b2b', '35f07bc3-f41f-4923-a417-eb01086d1c97', 'af408b97-c896-49ec-a14f-5b6ab50dbf32', 'd840b728-5da1-4227-9620-7e9ee6fc21b1'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:04 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:02:04 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:04 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:02:04 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Deleted volume successfully. Sep 09 18:02:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b6eab4be-7ddc-4d84-ab82-8c44d41d73a6 tempest-TestMinimumBasicScenario-811273006 None] Lock "cinder-e1e46beb-a585-4dfe-86bc-fcb787cbacd7-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:05 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:02:05 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:05 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.310s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:02:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:02:06 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-392f764a-9c1d-4745-9d57-b75a3d728c3d req-f64b9bee-891e-4e78-913e-4a7f4861e73a tempest-TestInstancesWithCinderVolumes-1172192216 None] Terminate volume connection completed successfully. Sep 09 18:02:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-392f764a-9c1d-4745-9d57-b75a3d728c3d req-f64b9bee-891e-4e78-913e-4a7f4861e73a tempest-TestInstancesWithCinderVolumes-1172192216 None] Deleting attachment fd9325e1-87f6-4d12-ae56-93ffd1cdd930. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "cinder-d1c5b9e2-6645-4e9e-aeb7-40e17b276994-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-d1c5b9e2-6645-4e9e-aeb7-40e17b276994-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "cinder-quobyte-d1c5b9e2-6645-4e9e-aeb7-40e17b276994" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-quobyte-d1c5b9e2-6645-4e9e-aeb7-40e17b276994" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98e7a3-a6a5-4d25-865b-b85cc0895a2e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:07 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 Sep 09 18:02:07 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:07 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:07 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994 Sep 09 18:02:07 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:07 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d1c5b9e2-6645-4e9e-aeb7-40e17b276994" returned: 0 in 0.250s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-quobyte-d1c5b9e2-6645-4e9e-aeb7-40e17b276994" released by "delete_volume" :: held 0.674s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:02:07 devstack cinder-volume[87202]: WARNING cinder.quota [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1511772050-43533544 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1511772050-43533544, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:02:07 devstack cinder-volume[87202]: WARNING cinder.quota [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1511772050-43533544 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1511772050-43533544, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:02:07 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Created reservations ['071d0266-2b27-4eb6-a941-e98e18657ba4', 'ea7aba97-74de-4a9e-993d-fb127c26694e', '998992d2-6f35-40d6-977a-a1981a6fdf58', 'ae79c8cc-f093-4715-b7be-0f6ba3a5a6ea'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:08 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:02:08 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:08 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.257s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:02:08 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Deleted volume successfully. Sep 09 18:02:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-996ada30-432d-4ad6-ac79-de512beaa266 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-d1c5b9e2-6645-4e9e-aeb7-40e17b276994-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:02:10 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-3f639b6a-380f-4c64-8e56-de63e5129ab5 req-a82b8225-8333-423f-abcc-d103f1b1cddc tempest-TestInstancesWithCinderVolumes-1172192216 None] Terminate volume connection completed successfully. Sep 09 18:02:10 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-3f639b6a-380f-4c64-8e56-de63e5129ab5 req-a82b8225-8333-423f-abcc-d103f1b1cddc tempest-TestInstancesWithCinderVolumes-1172192216 None] Deleting attachment c96e4f6d-59eb-412b-8eb7-4e1969764207. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:02:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "cinder-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:02:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:02:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "cinder-quobyte-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:02:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-quobyte-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19" acquired by "delete_volume" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:02:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[54468293-1875-432a-ac4d-94774b65fdfe]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:02:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:11 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 Sep 09 18:02:11 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:12 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19" returned: 0 in 0.455s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:12 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19 Sep 09 18:02:12 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:12 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19" returned: 0 in 0.270s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-quobyte-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19" released by "delete_volume" :: held 0.770s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:02:12 devstack cinder-volume[87202]: WARNING cinder.quota [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-326415748-1903998321 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-326415748-1903998321, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:02:12 devstack cinder-volume[87202]: WARNING cinder.quota [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-326415748-1903998321 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-326415748-1903998321, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Created reservations ['e5555fd4-334c-4b6d-ae01-b375ae99bf38', '81460019-2233-4ce9-8a3e-e3f856c09408', '459327c1-ae3d-440a-a14b-b7781b009e48', 'c2993916-14d8-4230-956a-3413012d4293'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:12 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:02:12 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:12 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.299s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:02:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Deleted volume successfully. Sep 09 18:02:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-80b83495-4c56-482b-ae8f-e296c929ec66 tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-3a38ebcf-9320-45d0-95b9-2a3b1cc0ec19-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:02:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-7f295909-3620-4f51-b19f-3487a4d81316 req-915db754-5e6a-4860-9887-2fedd546c263 tempest-TestInstancesWithCinderVolumes-1172192216 None] Terminate volume connection completed successfully. Sep 09 18:02:16 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-7f295909-3620-4f51-b19f-3487a4d81316 req-915db754-5e6a-4860-9887-2fedd546c263 tempest-TestInstancesWithCinderVolumes-1172192216 None] Deleting attachment 1e7bd96c-8a6d-46ca-961c-0bb2086622ba. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "cinder-01df03e2-1d74-4f18-a290-8e98d57536cb-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-01df03e2-1d74-4f18-a290-8e98d57536cb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "cinder-quobyte-01df03e2-1d74-4f18-a290-8e98d57536cb" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-quobyte-01df03e2-1d74-4f18-a290-8e98d57536cb" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6bf0e1-3765-47fb-a48d-396e520b4558]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:17 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb Sep 09 18:02:17 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:17 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb" returned: 0 in 0.403s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:17 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb Sep 09 18:02:17 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:17 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-01df03e2-1d74-4f18-a290-8e98d57536cb" returned: 0 in 0.260s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-quobyte-01df03e2-1d74-4f18-a290-8e98d57536cb" released by "delete_volume" :: held 0.708s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:02:18 devstack cinder-volume[87202]: WARNING cinder.quota [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1046539056-1383415152 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1046539056-1383415152, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:02:18 devstack cinder-volume[87202]: WARNING cinder.quota [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1046539056-1383415152 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1046539056-1383415152, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Created reservations ['110e1398-dcf1-46f7-9e38-b414b096d800', 'fd337f33-51c1-4ac6-a55c-b293edae7f1b', 'a57003af-2552-4c17-9c01-b5ef8ca559b7', '2bacf388-44f2-4cc9-a842-7f82e0063b90'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:18 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:02:18 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:18 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:02:18 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Deleted volume successfully. Sep 09 18:02:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bf989a0f-5f46-4fda-ac0f-62b71a59ec1f tempest-TestInstancesWithCinderVolumes-1172192216 None] Lock "cinder-01df03e2-1d74-4f18-a290-8e98d57536cb-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:02:28 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=39,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:02:28 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=35,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Flow 'volume_create_manager' (929bbc24-4ea4-4a23-92c6-3128e870f8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed55fef-563f-4d9f-81d0-a863d2c4952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed55fef-563f-4d9f-81d0-a863d2c4952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1723043321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c44876-892b-409d-a027-33d698abe7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68755533569d41d3a4e1d7d85b1b232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:02:41Z,use_quota=True,user_id='d35b49356d2f444690d4141442634883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d886ba-b802-4373-b9ce-83181d9ce38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d886ba-b802-4373-b9ce-83181d9ce38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6ad20c-d721-4a3b-9af0-ebf69765826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6ad20c-d721-4a3b-9af0-ebf69765826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40c44876-892b-409d-a027-33d698abe7df', 'volume_name': 'volume-40c44876-892b-409d-a027-33d698abe7df', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaeafde1-7521-4204-94e6-8cf500bd08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaeafde1-7521-4204-94e6-8cf500bd08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4ae917-d884-44ef-89d1-44c97af64ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:41 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Volume 40c44876-892b-409d-a027-33d698abe7df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40c44876-892b-409d-a027-33d698abe7df', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 18:02:41 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Trying to clone 40c44876-892b-409d-a027-33d698abe7df from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:02:42 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:02:42 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Image download 20.69 MB at 20.69 MB/s Sep 09 18:02:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[925449c3-0dd5-4c98-875c-1ccea8e26c3c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:02:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:42 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD Sep 09 18:02:42 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:42 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:42 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe is fetched for user d35b49356d2f444690d4141442634883. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:02:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e2e1fe-df34-42ee-8e55-382177b47b5c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:02:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:42 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD Sep 09 18:02:42 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:43 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1723043321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c44876-892b-409d-a027-33d698abe7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68755533569d41d3a4e1d7d85b1b232b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:02:41Z,use_quota=True,user_id='d35b49356d2f444690d4141442634883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Creating volume 40c44876-892b-409d-a027-33d698abe7df {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:02:43 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:43 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df 1073741824 Sep 09 18:02:43 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:43 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df 1073741824" returned: 0 in 0.447s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:43 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df Sep 09 18:02:43 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:43 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df" returned: 0 in 0.279s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Attempting download of d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 40c44876-892b-409d-a027-33d698abe7df. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c846fba0-26d2-4f6c-9106-ce73787023d2]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:02:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_3d3mi46o {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:43 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_3d3mi46o Sep 09 18:02:43 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:44 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_3d3mi46o" returned: 0 in 0.333s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_3d3mi46o {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:44 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_3d3mi46o Sep 09 18:02:44 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:44 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_3d3mi46o" returned: 1 in 0.323s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_3d3mi46o' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4ba0bf-f3af-4d52-99e1-e93e406ce81d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:44 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD Sep 09 18:02:44 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:44 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe was qcow2, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:02:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:44 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df Sep 09 18:02:44 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:46 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df" returned: 0 in 1.728s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe_m2y39lo_devstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:02:46 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Converted 112.00 MB image at 64.73 MB/s Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:46 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df 1G Sep 09 18:02:46 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:46 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df 1G" returned: 0 in 0.335s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Downloaded image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe ((None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}])) to volume 40c44876-892b-409d-a027-33d698abe7df successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Temporary image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe for user d35b49356d2f444690d4141442634883 is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Marking volume 40c44876-892b-409d-a027-33d698abe7df as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Copying metadata from image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe to 40c44876-892b-409d-a027-33d698abe7df. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:02:46 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Creating volume glance metadata for volume 40c44876-892b-409d-a027-33d698abe7df backed by image d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:02:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4ae917-d884-44ef-89d1-44c97af64ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c44876-892b-409d-a027-33d698abe7df', 'volume_size': 1, 'image_id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eb28bab86f4b48cca70a84d1fa394933', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1dc2b9d-02f6-4b5b-8ce7-c260477c9efe', 'created_at': datetime.datetime(2026, 9, 9, 15, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1dc2b9d-02f6-4b5b-8ce7-c260477c9efe/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e21612-6f32-4eef-9db5-d7ef55359885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:47 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Volume volume-40c44876-892b-409d-a027-33d698abe7df (40c44876-892b-409d-a027-33d698abe7df): created successfully Sep 09 18:02:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e21612-6f32-4eef-9db5-d7ef55359885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:47 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Flow 'volume_create_manager' (929bbc24-4ea4-4a23-92c6-3128e870f8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:02:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bcff9061-de1c-416d-bb88-30ed38a88ca2 tempest-TestShelveInstance-753951716 None] Created volume successfully. Sep 09 18:02:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bb3c0ced-3667-440d-be37-4ce4ae467c56 req-7dbf94c5-cb2e-4f6d-a8fb-9e91b2561758 tempest-TestShelveInstance-753951716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bb3c0ced-3667-440d-be37-4ce4ae467c56 req-7dbf94c5-cb2e-4f6d-a8fb-9e91b2561758 tempest-TestShelveInstance-753951716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-bb3c0ced-3667-440d-be37-4ce4ae467c56 req-7dbf94c5-cb2e-4f6d-a8fb-9e91b2561758 tempest-TestShelveInstance-753951716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:50 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-bb3c0ced-3667-440d-be37-4ce4ae467c56 req-7dbf94c5-cb2e-4f6d-a8fb-9e91b2561758 tempest-TestShelveInstance-753951716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-40c44876-892b-409d-a027-33d698abe7df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b8df63e-709c-4e6a-8b6a-0496253f240d', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:02:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-bb3c0ced-3667-440d-be37-4ce4ae467c56 req-7dbf94c5-cb2e-4f6d-a8fb-9e91b2561758 tempest-TestShelveInstance-753951716 None] attachment_update completed successfully. Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Flow 'volume_create_manager' (d83aa8ed-6bac-40f7-9195-d0056e8f50b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b559c23f-0192-42f9-99d0-27e21f6050ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b559c23f-0192-42f9-99d0-27e21f6050ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-759513983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217070bb-8c3a-41cd-9689-4eee3c4c9df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1831b35b78c4e80ad7e4acb94eae962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:02:53Z,use_quota=True,user_id='1b8e0f3697ac4fa8bf26aaad4c07863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4593c0c9-02c8-4c19-bdfd-08be0cd9e08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4593c0c9-02c8-4c19-bdfd-08be0cd9e08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e048cd-9f42-4604-88ce-a95737309c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e048cd-9f42-4604-88ce-a95737309c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217070bb-8c3a-41cd-9689-4eee3c4c9df7', 'volume_name': 'volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b710a135-011e-48cb-87d5-b2de3a2a4e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b710a135-011e-48cb-87d5-b2de3a2a4e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a7e84f-b6e0-4bb9-b956-29886186846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Volume 217070bb-8c3a-41cd-9689-4eee3c4c9df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7', 'volume_size': 1} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-759513983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217070bb-8c3a-41cd-9689-4eee3c4c9df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1831b35b78c4e80ad7e4acb94eae962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:02:53Z,use_quota=True,user_id='1b8e0f3697ac4fa8bf26aaad4c07863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Creating volume 217070bb-8c3a-41cd-9689-4eee3c4c9df7 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:02:53 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:53 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 1073741824 Sep 09 18:02:53 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Flow 'volume_create_manager' (3123c1f8-d479-499f-b89a-9c7333df1ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91988220-6113-4c4f-931b-b3341cd1cf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91988220-6113-4c4f-931b-b3341cd1cf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-925575874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e05ff8c-758d-4c9d-bd03-db9eba9e53e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1831b35b78c4e80ad7e4acb94eae962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:02:54Z,use_quota=True,user_id='1b8e0f3697ac4fa8bf26aaad4c07863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab064ed6-6797-4028-bb28-eb625568ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab064ed6-6797-4028-bb28-eb625568ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd39b38-71a0-43e9-869b-1161fbae160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd39b38-71a0-43e9-869b-1161fbae160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e05ff8c-758d-4c9d-bd03-db9eba9e53e9', 'volume_name': 'volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5f3b4c-ab48-4c6e-9842-c35719268f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5f3b4c-ab48-4c6e-9842-c35719268f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf5fbda-6629-468a-a4aa-0e2a23e64054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Volume 9e05ff8c-758d-4c9d-bd03-db9eba9e53e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9', 'volume_size': 1} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:53 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 1073741824" returned: 0 in 0.626s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:53 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 Sep 09 18:02:53 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:54 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7" returned: 0 in 0.332s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-925575874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e05ff8c-758d-4c9d-bd03-db9eba9e53e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1831b35b78c4e80ad7e4acb94eae962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:02:54Z,use_quota=True,user_id='1b8e0f3697ac4fa8bf26aaad4c07863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Creating volume 9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:02:54 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a7e84f-b6e0-4bb9-b956-29886186846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:54 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 1073741824 Sep 09 18:02:54 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7947eaf-88d1-4308-b971-8e7463c9d248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:54 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Volume volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 (217070bb-8c3a-41cd-9689-4eee3c4c9df7): created successfully Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7947eaf-88d1-4308-b971-8e7463c9d248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Flow 'volume_create_manager' (d83aa8ed-6bac-40f7-9195-d0056e8f50b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:02:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6d6fc825-d5d8-4dc4-83a3-16fb5247f163 tempest-TestServerVolumeAttachmentScenario-951167455 None] Created volume successfully. Sep 09 18:02:55 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 1073741824" returned: 0 in 0.942s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:02:55 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 Sep 09 18:02:55 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:02:55 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9" returned: 0 in 0.314s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf5fbda-6629-468a-a4aa-0e2a23e64054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b45fe7-15f1-40ba-b9cd-41c32227f3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:02:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Volume volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 (9e05ff8c-758d-4c9d-bd03-db9eba9e53e9): created successfully Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b45fe7-15f1-40ba-b9cd-41c32227f3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:02:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Flow 'volume_create_manager' (3123c1f8-d479-499f-b89a-9c7333df1ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:02:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-814b8023-4037-42a4-a5cc-18647f371938 tempest-TestServerVolumeAttachmentScenario-951167455 None] Created volume successfully. Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:05 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:03:05 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:05 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.344s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=18,cinder:INSERT=9,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:03:05 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=13,cinder:SELECT=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:03:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-e5a975c1-fe7a-407b-8093-80109a96628c req-a8571921-3699-47e8-97ae-93513ff76655 tempest-TestShelveInstance-753951716 None] Terminate volume connection completed successfully. Sep 09 18:03:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-e5a975c1-fe7a-407b-8093-80109a96628c req-a8571921-3699-47e8-97ae-93513ff76655 tempest-TestShelveInstance-753951716 None] Deleting attachment 1b8df63e-709c-4e6a-8b6a-0496253f240d. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:03:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-c4488960-6062-496b-b167-d73a7f4f1f13 req-892a7348-1825-4585-a61b-7c51c8e851c7 tempest-TestShelveInstance-753951716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-c4488960-6062-496b-b167-d73a7f4f1f13 req-892a7348-1825-4585-a61b-7c51c8e851c7 tempest-TestShelveInstance-753951716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-c4488960-6062-496b-b167-d73a7f4f1f13 req-892a7348-1825-4585-a61b-7c51c8e851c7 tempest-TestShelveInstance-753951716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:03:24 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-c4488960-6062-496b-b167-d73a7f4f1f13 req-892a7348-1825-4585-a61b-7c51c8e851c7 tempest-TestShelveInstance-753951716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-40c44876-892b-409d-a027-33d698abe7df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'def25115-7e47-4501-b4a6-7b12c4804bbb', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:03:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-c4488960-6062-496b-b167-d73a7f4f1f13 req-892a7348-1825-4585-a61b-7c51c8e851c7 tempest-TestShelveInstance-753951716 None] attachment_update completed successfully. Sep 09 18:03:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-5350366c-496c-4440-9cef-53e49594abe4 req-901e1f56-c61a-4592-a0ad-1ac359e55e50 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-5350366c-496c-4440-9cef-53e49594abe4 req-901e1f56-c61a-4592-a0ad-1ac359e55e50 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-5350366c-496c-4440-9cef-53e49594abe4 req-901e1f56-c61a-4592-a0ad-1ac359e55e50 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:03:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-5350366c-496c-4440-9cef-53e49594abe4 req-901e1f56-c61a-4592-a0ad-1ac359e55e50 tempest-TestServerVolumeAttachmentScenario-951167455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a61e9976-1cab-40bc-bf68-fb21066c8490', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:03:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-5350366c-496c-4440-9cef-53e49594abe4 req-901e1f56-c61a-4592-a0ad-1ac359e55e50 tempest-TestServerVolumeAttachmentScenario-951167455 None] attachment_update completed successfully. Sep 09 18:03:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-92dfb74a-edd1-4478-90ad-0b02d15e09e1 req-a6b06c5a-892d-4c28-9815-f44406aa170d tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-92dfb74a-edd1-4478-90ad-0b02d15e09e1 req-a6b06c5a-892d-4c28-9815-f44406aa170d tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-92dfb74a-edd1-4478-90ad-0b02d15e09e1 req-a6b06c5a-892d-4c28-9815-f44406aa170d tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:03:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-92dfb74a-edd1-4478-90ad-0b02d15e09e1 req-a6b06c5a-892d-4c28-9815-f44406aa170d tempest-TestServerVolumeAttachmentScenario-951167455 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf', 'name': 'volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bd023aa-a26b-4cd0-813a-0d4798ff0d0b', 'enforce_multipath': True} {{(pid=87202) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:03:32 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-92dfb74a-edd1-4478-90ad-0b02d15e09e1 req-a6b06c5a-892d-4c28-9815-f44406aa170d tempest-TestServerVolumeAttachmentScenario-951167455 None] attachment_update completed successfully. Sep 09 18:03:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-ab755a78-2f8f-4d0f-9dc2-7b7198a7b5c5 req-872ceeba-2d27-410a-951f-19788260112e tempest-TestServerVolumeAttachmentScenario-951167455 None] Terminate volume connection completed successfully. Sep 09 18:03:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-ab755a78-2f8f-4d0f-9dc2-7b7198a7b5c5 req-872ceeba-2d27-410a-951f-19788260112e tempest-TestServerVolumeAttachmentScenario-951167455 None] Deleting attachment 0bd023aa-a26b-4cd0-813a-0d4798ff0d0b. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:03:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-35186f26-c83c-4389-a6b1-94d23179d787 req-8972965a-2a9d-4b9c-abc2-5db1133bf9f7 tempest-TestServerVolumeAttachmentScenario-951167455 None] Terminate volume connection completed successfully. Sep 09 18:03:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-35186f26-c83c-4389-a6b1-94d23179d787 req-8972965a-2a9d-4b9c-abc2-5db1133bf9f7 tempest-TestServerVolumeAttachmentScenario-951167455 None] Deleting attachment a61e9976-1cab-40bc-bf68-fb21066c8490. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:03:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "cinder-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:03:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "cinder-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "cinder-quobyte-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "cinder-quobyte-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9" acquired by "delete_volume" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d758b7c-7fa8-41ec-92ba-ef4b45323d2a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:40 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 Sep 09 18:03:40 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:40 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9" returned: 0 in 0.351s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:40 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9 Sep 09 18:03:40 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:40 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9" returned: 0 in 0.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "cinder-quobyte-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9" released by "delete_volume" :: held 0.629s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Created reservations ['91a1c3f2-1a09-4b89-a96d-97efe62de10c', '058cadc1-a166-4ae0-9561-b587e48c1ae3', 'eebd444e-7203-4940-965d-be06148b11e4', 'f0708c6b-ba8e-46b4-a2a8-0830feb26292'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:03:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:40 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:03:40 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:41 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.252s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:03:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Deleted volume successfully. Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f0167eda-f8b4-4969-b67d-e30dff1cf1d5 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "cinder-9e05ff8c-758d-4c9d-bd03-db9eba9e53e9-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "cinder-217070bb-8c3a-41cd-9689-4eee3c4c9df7-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "cinder-217070bb-8c3a-41cd-9689-4eee3c4c9df7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "cinder-quobyte-217070bb-8c3a-41cd-9689-4eee3c4c9df7" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "cinder-quobyte-217070bb-8c3a-41cd-9689-4eee3c4c9df7" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d9ad74-ddc3-4714-b45b-586381572fcf]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:41 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 Sep 09 18:03:41 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:41 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7" returned: 0 in 0.354s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:41 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7 Sep 09 18:03:41 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:41 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-217070bb-8c3a-41cd-9689-4eee3c4c9df7" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "cinder-quobyte-217070bb-8c3a-41cd-9689-4eee3c4c9df7" released by "delete_volume" :: held 0.640s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Created reservations ['4596a9d9-bf44-402b-8ef9-086b765d314b', '227aa6dc-85b7-4698-9a8a-49a5a3d760ca', '17cff98e-75b9-40df-9a21-25f3e1478b69', '3e047d39-c774-43f8-8f71-a8716a11aa76'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:03:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:41 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:03:41 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:42 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:42 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:03:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Deleted volume successfully. Sep 09 18:03:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-74e9433c-efa2-41bf-b553-33d535687a01 tempest-TestServerVolumeAttachmentScenario-951167455 None] Lock "cinder-217070bb-8c3a-41cd-9689-4eee3c4c9df7-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:03:51 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=33,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:03:52 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=33,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:03:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-74574426-4b9c-48db-b2c7-4eb861246ad3 tempest-TestShelveInstance-753951716 None] Terminate volume connection completed successfully. Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-74574426-4b9c-48db-b2c7-4eb861246ad3 tempest-TestShelveInstance-753951716 None] Deleting attachment def25115-7e47-4501-b4a6-7b12c4804bbb. {{(pid=87202) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Acquiring lock "cinder-40c44876-892b-409d-a027-33d698abe7df-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Lock "cinder-40c44876-892b-409d-a027-33d698abe7df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Acquiring lock "cinder-quobyte-40c44876-892b-409d-a027-33d698abe7df" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Lock "cinder-quobyte-40c44876-892b-409d-a027-33d698abe7df" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e49dcf-1a80-4259-9efa-9711621f420c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:55 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df Sep 09 18:03:55 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:55 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df" returned: 0 in 0.425s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:56 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df Sep 09 18:03:56 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:56 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-40c44876-892b-409d-a027-33d698abe7df" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Lock "cinder-quobyte-40c44876-892b-409d-a027-33d698abe7df" released by "delete_volume" :: held 0.716s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG cinder.quota [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Created reservations ['a75ea3d2-62f2-41a7-9d2c-a132bf44c3bf', 'b4f7128c-799c-4b04-b046-aca7b10d395b', '816bb5e2-1d37-44dc-82e7-815687149c0c', 'e0f33a84-4661-4e8e-90f7-c5884b37818c'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:56 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:03:56 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:56 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.265s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG cinder.manager [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:03:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Deleted volume successfully. Sep 09 18:03:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [req-f2e2d0fc-42b5-49f0-ab02-cb33d85298ad req-87ebff63-0682-48d1-a78c-936dbaa7198b tempest-TestShelveInstance-753951716 None] Lock "cinder-40c44876-892b-409d-a027-33d698abe7df-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Flow 'volume_create_manager' (af4a8ce2-a3ea-439e-af5a-0509f4b9fa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98272bfe-2921-467d-b5d7-81a5ccc83053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98272bfe-2921-467d-b5d7-81a5ccc83053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e664cc-d240-453e-9811-0cd20ef164a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145eacf854204beca4f8c923432d1073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:03:57Z,use_quota=True,user_id='dc35f063ca834b419d42a7b8fbbeca34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e17ee96-afd6-4eb6-aed9-0d212421fb31),volume_type_id=9e17ee96-afd6-4eb6-aed9-0d212421fb31)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf2bc7c-cbdb-4fdc-834a-8f19ee77ccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf2bc7c-cbdb-4fdc-834a-8f19ee77ccd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bf1a74-e747-4efd-b88d-0b8f321504ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83bf1a74-e747-4efd-b88d-0b8f321504ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4e664cc-d240-453e-9811-0cd20ef164a6', 'volume_name': 'volume-c4e664cc-d240-453e-9811-0cd20ef164a6', 'volume_size': 1, 'image_id': '242e9781-6536-437b-a214-8281d2b3f561', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/242e9781-6536-437b-a214-8281d2b3f561', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75e01bd1f357be49873bc2e78295194f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '145eacf854204beca4f8c923432d1073', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '102091ccd6ad8f92877067c5c4a5251a2e410186b8ddb671d1d58aa16066414e375efbf14951d2c644ab2e6e6231ce9068bacd5af6c4627d05a01aa761f0afc0', 'id': '242e9781-6536-437b-a214-8281d2b3f561', 'created_at': datetime.datetime(2026, 9, 9, 16, 3, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 3, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/242e9781-6536-437b-a214-8281d2b3f561/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a92459-196a-4751-bb94-14e219f9e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a92459-196a-4751-bb94-14e219f9e57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908b9d2c-d382-49b5-9e6e-9317a455b6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:03:57 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Volume c4e664cc-d240-453e-9811-0cd20ef164a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4e664cc-d240-453e-9811-0cd20ef164a6', 'volume_size': 1, 'image_id': '242e9781-6536-437b-a214-8281d2b3f561', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/242e9781-6536-437b-a214-8281d2b3f561', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75e01bd1f357be49873bc2e78295194f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '145eacf854204beca4f8c923432d1073', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '102091ccd6ad8f92877067c5c4a5251a2e410186b8ddb671d1d58aa16066414e375efbf14951d2c644ab2e6e6231ce9068bacd5af6c4627d05a01aa761f0afc0', 'id': '242e9781-6536-437b-a214-8281d2b3f561', 'created_at': datetime.datetime(2026, 9, 9, 16, 3, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 3, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/242e9781-6536-437b-a214-8281d2b3f561/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Trying to clone c4e664cc-d240-453e-9811-0cd20ef164a6 from image 242e9781-6536-437b-a214-8281d2b3f561 at location (None, [{'url': 'file:///opt/stack/data/glance/images/242e9781-6536-437b-a214-8281d2b3f561', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:03:57 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Image download 0.00 MB at 0.00 MB/s Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffe0529-2ff0-4f5d-a807-4103b0849abb]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:03:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:58 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD Sep 09 18:03:58 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:58 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:58 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD Sep 09 18:03:58 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:58 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:03:58 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Temporary image 242e9781-6536-437b-a214-8281d2b3f561 is fetched for user dc35f063ca834b419d42a7b8fbbeca34. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:03:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9264224e-b692-41aa-bd7c-64d75d90c7d6]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:03:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:58 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD Sep 09 18:03:58 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:59 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:59 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD Sep 09 18:03:59 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:59 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e664cc-d240-453e-9811-0cd20ef164a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145eacf854204beca4f8c923432d1073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:03:57Z,use_quota=True,user_id='dc35f063ca834b419d42a7b8fbbeca34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e17ee96-afd6-4eb6-aed9-0d212421fb31),volume_type_id=9e17ee96-afd6-4eb6-aed9-0d212421fb31)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Creating volume c4e664cc-d240-453e-9811-0cd20ef164a6 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:03:59 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:59 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 1073741824 Sep 09 18:03:59 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:03:59 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 1073741824" returned: 0 in 0.390s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:03:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:03:59 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 Sep 09 18:03:59 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:00 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6" returned: 0 in 0.233s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Attempting download of 242e9781-6536-437b-a214-8281d2b3f561 ((None, [{'url': 'file:///opt/stack/data/glance/images/242e9781-6536-437b-a214-8281d2b3f561', 'metadata': {}}])) to volume c4e664cc-d240-453e-9811-0cd20ef164a6. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fad8f5-7f1b-467d-a9cc-954c1bfd1546]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_242e9781-6536-437b-a214-8281d2b3f561_1y92_mw3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:00 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_242e9781-6536-437b-a214-8281d2b3f561_1y92_mw3 Sep 09 18:04:00 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:00 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_242e9781-6536-437b-a214-8281d2b3f561_1y92_mw3" returned: 0 in 0.337s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_242e9781-6536-437b-a214-8281d2b3f561_1y92_mw3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:00 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_242e9781-6536-437b-a214-8281d2b3f561_1y92_mw3 Sep 09 18:04:00 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:00 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_242e9781-6536-437b-a214-8281d2b3f561_1y92_mw3" returned: 1 in 0.381s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_242e9781-6536-437b-a214-8281d2b3f561_1y92_mw3' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4145c9-896b-4088-9b16-9cc7477665d4]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:04:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:01 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD Sep 09 18:04:01 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:01 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:01 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD Sep 09 18:04:01 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:01 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:04:01 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] 242e9781-6536-437b-a214-8281d2b3f561 was raw, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:04:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:01 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 Sep 09 18:04:01 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:02 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6" returned: 0 in 0.454s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_242e9781-6536-437b-a214-8281d2b3f561_2oepiwildevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:04:02 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:02 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 1G Sep 09 18:04:02 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:02 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 1G" returned: 0 in 0.305s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Downloaded image 242e9781-6536-437b-a214-8281d2b3f561 ((None, [{'url': 'file:///opt/stack/data/glance/images/242e9781-6536-437b-a214-8281d2b3f561', 'metadata': {}}])) to volume c4e664cc-d240-453e-9811-0cd20ef164a6 successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Temporary image 242e9781-6536-437b-a214-8281d2b3f561 for user dc35f063ca834b419d42a7b8fbbeca34 is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Marking volume c4e664cc-d240-453e-9811-0cd20ef164a6 as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Copying metadata from image 242e9781-6536-437b-a214-8281d2b3f561 to c4e664cc-d240-453e-9811-0cd20ef164a6. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Creating volume glance metadata for volume c4e664cc-d240-453e-9811-0cd20ef164a6 backed by image 242e9781-6536-437b-a214-8281d2b3f561 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '242e9781-6536-437b-a214-8281d2b3f561', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '75e01bd1f357be49873bc2e78295194f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908b9d2c-d382-49b5-9e6e-9317a455b6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e664cc-d240-453e-9811-0cd20ef164a6', 'volume_size': 1, 'image_id': '242e9781-6536-437b-a214-8281d2b3f561', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/242e9781-6536-437b-a214-8281d2b3f561', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75e01bd1f357be49873bc2e78295194f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '145eacf854204beca4f8c923432d1073', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '102091ccd6ad8f92877067c5c4a5251a2e410186b8ddb671d1d58aa16066414e375efbf14951d2c644ab2e6e6231ce9068bacd5af6c4627d05a01aa761f0afc0', 'id': '242e9781-6536-437b-a214-8281d2b3f561', 'created_at': datetime.datetime(2026, 9, 9, 16, 3, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 3, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/242e9781-6536-437b-a214-8281d2b3f561/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bba1a2-38bd-4ff7-9b92-43f6d621ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:04:02 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Volume volume-c4e664cc-d240-453e-9811-0cd20ef164a6 (c4e664cc-d240-453e-9811-0cd20ef164a6): created successfully Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bba1a2-38bd-4ff7-9b92-43f6d621ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Flow 'volume_create_manager' (af4a8ce2-a3ea-439e-af5a-0509f4b9fa92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:04:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-621f2c72-c73b-40c7-b529-c34d97f349d0 tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Created volume successfully. Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Acquiring lock "cinder-c4e664cc-d240-453e-9811-0cd20ef164a6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "cinder-c4e664cc-d240-453e-9811-0cd20ef164a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Acquiring lock "cinder-quobyte-c4e664cc-d240-453e-9811-0cd20ef164a6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "cinder-quobyte-c4e664cc-d240-453e-9811-0cd20ef164a6" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[73254157-4a3e-4c31-9586-2c0c16bdcee1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:04:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:02 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 Sep 09 18:04:02 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:03 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6" returned: 0 in 0.362s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:03 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6 Sep 09 18:04:03 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:03 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c4e664cc-d240-453e-9811-0cd20ef164a6" returned: 0 in 0.235s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "cinder-quobyte-c4e664cc-d240-453e-9811-0cd20ef164a6" released by "delete_volume" :: held 0.638s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:04:03 devstack cinder-volume[87202]: WARNING cinder.quota [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:04:03 devstack cinder-volume[87202]: WARNING cinder.quota [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Created reservations ['c9a286cf-04db-4553-9f16-64abf9a7c9cf', '7824348e-476e-4aec-9f32-f642a4f03f2a', '910cb1b4-97cc-470d-ac22-1b925564cf9e', 'de2f6795-f44a-4ad2-9411-4b98286ff3cd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:03 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:04:03 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:03 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.266s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:04:03 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Deleted volume successfully. Sep 09 18:04:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4d89d0a8-6554-4f62-9910-c304c73c159f tempest-VolumeAndVolumeTypeFromImageTest-182014278 None] Lock "cinder-c4e664cc-d240-453e-9811-0cd20ef164a6-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:05 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:04:05 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:05 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.278s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:04:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:04:13 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=14,cinder:UPDATE=25,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:04:13 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=24,cinder:INSERT=6,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Flow 'volume_create_manager' (0369f272-bbe3-48fc-a4c8-156c5c9deeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d134db2e-b7ef-4a63-87b4-ad29c9bca49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d134db2e-b7ef-4a63-87b4-ad29c9bca49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-390455557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23798c8a-77cc-44bd-ba53-2fe9a8e18611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30616311862414c96f7081c4a490b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:04:27Z,use_quota=True,user_id='b7eb85b003404abcb8d73299dd0f0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018bb2e9-e443-4b95-bcee-6217d3a074c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018bb2e9-e443-4b95-bcee-6217d3a074c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b89adb-4998-4874-94bb-76b5c7550c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b89adb-4998-4874-94bb-76b5c7550c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23798c8a-77cc-44bd-ba53-2fe9a8e18611', 'volume_name': 'volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99430d0-ab34-420d-bddd-48dc3fcac8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99430d0-ab34-420d-bddd-48dc3fcac8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6c0735-5692-4862-87f5-6e18773ea3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:04:27 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Volume 23798c8a-77cc-44bd-ba53-2fe9a8e18611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611', 'volume_size': 1} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-390455557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23798c8a-77cc-44bd-ba53-2fe9a8e18611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30616311862414c96f7081c4a490b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:04:27Z,use_quota=True,user_id='b7eb85b003404abcb8d73299dd0f0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Creating volume 23798c8a-77cc-44bd-ba53-2fe9a8e18611 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:04:27 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:27 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 1073741824 Sep 09 18:04:27 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:27 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 1073741824" returned: 0 in 0.402s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:27 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 Sep 09 18:04:27 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:27 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611" returned: 0 in 0.240s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6c0735-5692-4862-87f5-6e18773ea3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23853290-3129-4e01-b8d9-0bfc8b65957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:04:27 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Volume volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 (23798c8a-77cc-44bd-ba53-2fe9a8e18611): created successfully Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23853290-3129-4e01-b8d9-0bfc8b65957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:04:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Flow 'volume_create_manager' (0369f272-bbe3-48fc-a4c8-156c5c9deeb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:04:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8ebb54f4-eb0f-4e4a-97f8-b4b4dab3bb94 tempest-TestImageHashVerification-801421612 None] Created volume successfully. Sep 09 18:04:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:04:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:04:28 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[176233c7-f7d3-4de6-8988-11d25f8ae9b3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:04:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:28 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 Sep 09 18:04:28 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:29 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611" returned: 0 in 0.336s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:29 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5bf88-1670-4bcc-9b53-f8e6d2bb885a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:04:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:29 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 Sep 09 18:04:29 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:29 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 /opt/stack/data/cinder/conversion/23798c8a-77cc-44bd-ba53-2fe9a8e18611.temp_image.873ee3ef-b8f1-4cd0-b1e0-f820c1f90dc6ebaetu4r.img {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:29 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 /opt/stack/data/cinder/conversion/23798c8a-77cc-44bd-ba53-2fe9a8e18611.temp_image.873ee3ef-b8f1-4cd0-b1e0-f820c1f90dc6ebaetu4r.img Sep 09 18:04:29 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:33 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 /opt/stack/data/cinder/conversion/23798c8a-77cc-44bd-ba53-2fe9a8e18611.temp_image.873ee3ef-b8f1-4cd0-b1e0-f820c1f90dc6ebaetu4r.img" returned: 0 in 3.723s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:33 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bf5e25-9904-4c8e-bb97-a84e0c1d09f4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:04:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:33 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 Sep 09 18:04:33 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:33 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611" returned: 0 in 0.506s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:33 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611, size 1024.00 MB, duration 3.72 sec, destination /opt/stack/data/cinder/conversion/23798c8a-77cc-44bd-ba53-2fe9a8e18611.temp_image.873ee3ef-b8f1-4cd0-b1e0-f820c1f90dc6ebaetu4r.img {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:04:33 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Converted 1024.00 MB image at 274.95 MB/s Sep 09 18:04:33 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] 873ee3ef-b8f1-4cd0-b1e0-f820c1f90dc6 was raw, no need to convert to raw {{(pid=87202) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 18:04:43 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:04:43 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:04:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.787s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:04:51 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Uploaded volume to glance image-id: 873ee3ef-b8f1-4cd0-b1e0-f820c1f90dc6. {{(pid=87202) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 18:04:51 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f34be9b4-59eb-461d-b5cd-ccb130df796b tempest-TestImageHashVerification-801421612 None] Copy volume to image completed successfully. Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Acquiring lock "cinder-23798c8a-77cc-44bd-ba53-2fe9a8e18611-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Lock "cinder-23798c8a-77cc-44bd-ba53-2fe9a8e18611-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Acquiring lock "cinder-quobyte-23798c8a-77cc-44bd-ba53-2fe9a8e18611" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Lock "cinder-quobyte-23798c8a-77cc-44bd-ba53-2fe9a8e18611" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4a7927-fe2b-46a2-b0a1-385f72485c9f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:52 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 Sep 09 18:04:52 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:52 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611" returned: 0 in 0.347s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:52 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611 Sep 09 18:04:52 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:52 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-23798c8a-77cc-44bd-ba53-2fe9a8e18611" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Lock "cinder-quobyte-23798c8a-77cc-44bd-ba53-2fe9a8e18611" released by "delete_volume" :: held 0.630s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Created reservations ['8edfa4fc-5c2d-45d7-ba9a-70a1de21442a', '72aa3226-b624-46a0-8029-fdea51cd59bd', '1bfd2cca-3ecb-4ceb-964b-0655e6b896e7', 'cf854fbf-d31d-43d9-9253-9351be2945ab'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:04:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:04:52 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:04:52 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:04:53 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 09 18:04:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:04:53 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:04:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Deleted volume successfully. Sep 09 18:04:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0fb3ffe6-7c5a-4ec9-b4c0-4b1794c091b9 tempest-TestImageHashVerification-801421612 None] Lock "cinder-23798c8a-77cc-44bd-ba53-2fe9a8e18611-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:02 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:05:03 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:05 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:05 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:05 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.272s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:05:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:05:08 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Flow 'volume_create_manager' (ce7aca6e-d769-4fb3-8249-278912451550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe22e1ea-f72c-4501-aa5f-91f67dd6e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe22e1ea-f72c-4501-aa5f-91f67dd6e552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117913117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ede721-6f2d-46f7-b7a5-1468ac90442a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa80242239d24fa5974dbbcda8b36040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:09Z,use_quota=True,user_id='3e8b684a39d14696b574bd37e881763c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1f82b9-48ac-423f-a7bf-af3339a6b4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1f82b9-48ac-423f-a7bf-af3339a6b4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c98a4eb-5a24-4dad-8d7a-18d5f1dd7813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c98a4eb-5a24-4dad-8d7a-18d5f1dd7813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ede721-6f2d-46f7-b7a5-1468ac90442a', 'volume_name': 'volume-99ede721-6f2d-46f7-b7a5-1468ac90442a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e958d8f6-a667-444f-8540-5f8ea5495693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e958d8f6-a667-444f-8540-5f8ea5495693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eade5562-26b4-4747-8cf4-cc1e19d0edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:09 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Volume 99ede721-6f2d-46f7-b7a5-1468ac90442a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ede721-6f2d-46f7-b7a5-1468ac90442a', 'volume_size': 1} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117913117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ede721-6f2d-46f7-b7a5-1468ac90442a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa80242239d24fa5974dbbcda8b36040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:09Z,use_quota=True,user_id='3e8b684a39d14696b574bd37e881763c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Creating volume 99ede721-6f2d-46f7-b7a5-1468ac90442a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:09 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:09 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a 1073741824 Sep 09 18:05:09 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:09 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a 1073741824" returned: 0 in 0.417s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:09 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a Sep 09 18:05:09 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:09 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a" returned: 0 in 0.253s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eade5562-26b4-4747-8cf4-cc1e19d0edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ede721-6f2d-46f7-b7a5-1468ac90442a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6a686d-4192-43bb-8bec-9b60632698f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:09 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Volume volume-99ede721-6f2d-46f7-b7a5-1468ac90442a (99ede721-6f2d-46f7-b7a5-1468ac90442a): created successfully Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6a686d-4192-43bb-8bec-9b60632698f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Flow 'volume_create_manager' (ce7aca6e-d769-4fb3-8249-278912451550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:09 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f68b3c33-452c-4c12-9f8d-90751d01fe1b tempest-ProjectReaderTests-1296488993 None] Created volume successfully. Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "cinder-99ede721-6f2d-46f7-b7a5-1468ac90442a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-99ede721-6f2d-46f7-b7a5-1468ac90442a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "cinder-quobyte-99ede721-6f2d-46f7-b7a5-1468ac90442a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-quobyte-99ede721-6f2d-46f7-b7a5-1468ac90442a" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8969e6ef-e5e8-46f3-a045-565c67c160af]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:10 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a Sep 09 18:05:10 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:10 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a" returned: 0 in 0.337s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:10 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a Sep 09 18:05:10 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:10 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-99ede721-6f2d-46f7-b7a5-1468ac90442a" returned: 0 in 0.251s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-quobyte-99ede721-6f2d-46f7-b7a5-1468ac90442a" released by "delete_volume" :: held 0.624s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Created reservations ['6a103643-8270-4921-8cac-2c487810672e', 'b8353945-620a-4909-b3c8-5a68e66d57b8', '51d94fcf-1dd9-467b-9e4b-5add781b1236', 'b14000e1-4a40-4981-b197-eeb8a3d5638f'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:10 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:10 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:11 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Deleted volume successfully. Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-0bda3444-45f2-41b3-a7b2-3530e7f7ae36 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-99ede721-6f2d-46f7-b7a5-1468ac90442a-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Flow 'volume_create_manager' (3f604a95-104d-4d19-a6c7-62618bfff12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7729da-92d8-4b66-a5f1-2771aa8dde1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7729da-92d8-4b66-a5f1-2771aa8dde1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185608182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e913fee-11ed-431a-8d32-3b0d5bda54e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa80242239d24fa5974dbbcda8b36040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:12Z,use_quota=True,user_id='3e8b684a39d14696b574bd37e881763c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1c1519-d9d8-4389-9cc4-e6875e7ccd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1c1519-d9d8-4389-9cc4-e6875e7ccd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b6f604-5462-4f96-b254-0ac8771965a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b6f604-5462-4f96-b254-0ac8771965a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e913fee-11ed-431a-8d32-3b0d5bda54e6', 'volume_name': 'volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245cf69d-4b74-408b-b2d8-3635710b2206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245cf69d-4b74-408b-b2d8-3635710b2206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f98e87-695b-40eb-a44f-d9cdf5adf693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:11 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Volume 5e913fee-11ed-431a-8d32-3b0d5bda54e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6', 'volume_size': 1} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185608182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e913fee-11ed-431a-8d32-3b0d5bda54e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa80242239d24fa5974dbbcda8b36040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:12Z,use_quota=True,user_id='3e8b684a39d14696b574bd37e881763c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Creating volume 5e913fee-11ed-431a-8d32-3b0d5bda54e6 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:11 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:11 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 1073741824 Sep 09 18:05:11 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:12 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 1073741824" returned: 0 in 0.414s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:12 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 Sep 09 18:05:12 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:12 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6" returned: 0 in 0.241s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f98e87-695b-40eb-a44f-d9cdf5adf693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af08d410-b60a-4304-992b-5a6d7bec2483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:12 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Volume volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 (5e913fee-11ed-431a-8d32-3b0d5bda54e6): created successfully Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af08d410-b60a-4304-992b-5a6d7bec2483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Flow 'volume_create_manager' (3f604a95-104d-4d19-a6c7-62618bfff12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-26fa4090-7701-4730-8daa-5f9d6fc118dc tempest-ProjectReaderTests-1296488993 None] Created volume successfully. Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "cinder-5e913fee-11ed-431a-8d32-3b0d5bda54e6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-5e913fee-11ed-431a-8d32-3b0d5bda54e6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "cinder-quobyte-5e913fee-11ed-431a-8d32-3b0d5bda54e6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-quobyte-5e913fee-11ed-431a-8d32-3b0d5bda54e6" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e0cb20-fe5f-4b85-9ec5-92264206440f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:12 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 Sep 09 18:05:12 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:13 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6" returned: 0 in 0.346s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:13 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6 Sep 09 18:05:13 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:13 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5e913fee-11ed-431a-8d32-3b0d5bda54e6" returned: 0 in 0.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-quobyte-5e913fee-11ed-431a-8d32-3b0d5bda54e6" released by "delete_volume" :: held 0.618s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Created reservations ['4754c6ad-0d0e-47c0-b487-6f545deb873e', 'a6685d55-9f7d-4104-904f-f16459d41264', 'cc07f219-8b77-4d0e-b06d-419e3a7b17e9', 'b38e2945-e2ec-4e1c-ac14-cf601e097516'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:13 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:13 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:13 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.244s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Deleted volume successfully. Sep 09 18:05:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-985fbda5-3f9a-432d-a00b-74f566a0f608 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-5e913fee-11ed-431a-8d32-3b0d5bda54e6-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Flow 'volume_create_manager' (035de680-d270-4d63-a07d-aa801736738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87597218-3464-4d8c-8fb7-94b7dd20ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87597218-3464-4d8c-8fb7-94b7dd20ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261083962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5927c1ea-6201-422e-82f1-aff29e511592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa80242239d24fa5974dbbcda8b36040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:14Z,use_quota=True,user_id='3e8b684a39d14696b574bd37e881763c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7a0c28-8782-45ef-8cd3-d5227e616a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7a0c28-8782-45ef-8cd3-d5227e616a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a5adc0-e6e9-4a05-9964-003a947fd481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a5adc0-e6e9-4a05-9964-003a947fd481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5927c1ea-6201-422e-82f1-aff29e511592', 'volume_name': 'volume-5927c1ea-6201-422e-82f1-aff29e511592', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40286127-0414-4d18-b6ec-1da98fc525f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40286127-0414-4d18-b6ec-1da98fc525f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79550522-b73f-4616-b4c5-b8be379c9068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Volume 5927c1ea-6201-422e-82f1-aff29e511592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5927c1ea-6201-422e-82f1-aff29e511592', 'volume_size': 1} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261083962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5927c1ea-6201-422e-82f1-aff29e511592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa80242239d24fa5974dbbcda8b36040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:14Z,use_quota=True,user_id='3e8b684a39d14696b574bd37e881763c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Creating volume 5927c1ea-6201-422e-82f1-aff29e511592 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:14 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:14 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 1073741824 Sep 09 18:05:14 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:14 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 1073741824" returned: 0 in 0.384s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:14 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 Sep 09 18:05:14 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:15 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592" returned: 0 in 0.239s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79550522-b73f-4616-b4c5-b8be379c9068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5927c1ea-6201-422e-82f1-aff29e511592', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc95b75-c006-48f0-b88a-14f46e2a844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:15 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Volume volume-5927c1ea-6201-422e-82f1-aff29e511592 (5927c1ea-6201-422e-82f1-aff29e511592): created successfully Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc95b75-c006-48f0-b88a-14f46e2a844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Flow 'volume_create_manager' (035de680-d270-4d63-a07d-aa801736738d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-47e450c0-9bb3-4853-9a12-af14b10d9739 tempest-ProjectReaderTests-1296488993 None] Created volume successfully. Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "cinder-5927c1ea-6201-422e-82f1-aff29e511592-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-5927c1ea-6201-422e-82f1-aff29e511592-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "cinder-quobyte-5927c1ea-6201-422e-82f1-aff29e511592" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-quobyte-5927c1ea-6201-422e-82f1-aff29e511592" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd59b36-c3e4-4118-afd6-2472f9c9e806]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:15 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 Sep 09 18:05:15 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:15 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592" returned: 0 in 0.358s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:15 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592 Sep 09 18:05:15 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:16 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5927c1ea-6201-422e-82f1-aff29e511592" returned: 0 in 0.230s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-quobyte-5927c1ea-6201-422e-82f1-aff29e511592" released by "delete_volume" :: held 0.624s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Created reservations ['e4b3261d-97d3-43e5-aaef-375b566e8e31', 'e9e76e52-71b7-441e-bb28-58bb5fefedd6', 'ee121612-5c46-4592-bc47-4a8e1477bc7f', '0f4674fb-0f3d-47d7-ab0d-e04ae718f57b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:16 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:16 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:16 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.234s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Deleted volume successfully. Sep 09 18:05:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-a5892bc9-6816-4165-ba50-4b637626aeb7 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-5927c1ea-6201-422e-82f1-aff29e511592-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Flow 'volume_create_manager' (c6b1f345-f990-4f07-b073-6a7e50c16b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4943b3-6d10-4c2a-85d3-962fea89acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4943b3-6d10-4c2a-85d3-962fea89acf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964018644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148c84fd-f7a8-4229-ba4e-808cdfde0761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa80242239d24fa5974dbbcda8b36040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:17Z,use_quota=True,user_id='3e8b684a39d14696b574bd37e881763c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15dacdc-9b02-495b-81dc-e0d55dd4b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d15dacdc-9b02-495b-81dc-e0d55dd4b977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c8fb35-943b-41b4-a101-86d8ce0380f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c8fb35-943b-41b4-a101-86d8ce0380f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '148c84fd-f7a8-4229-ba4e-808cdfde0761', 'volume_name': 'volume-148c84fd-f7a8-4229-ba4e-808cdfde0761', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca740485-1621-4ebe-86cf-606d24698f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca740485-1621-4ebe-86cf-606d24698f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c249158-60c1-4b0f-88b3-8637594cf654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:17 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Volume 148c84fd-f7a8-4229-ba4e-808cdfde0761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-148c84fd-f7a8-4229-ba4e-808cdfde0761', 'volume_size': 1} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964018644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148c84fd-f7a8-4229-ba4e-808cdfde0761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa80242239d24fa5974dbbcda8b36040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:17Z,use_quota=True,user_id='3e8b684a39d14696b574bd37e881763c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Creating volume 148c84fd-f7a8-4229-ba4e-808cdfde0761 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:17 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:17 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 1073741824 Sep 09 18:05:17 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:17 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 1073741824" returned: 0 in 0.384s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:17 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 Sep 09 18:05:17 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:17 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761" returned: 0 in 0.240s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c249158-60c1-4b0f-88b3-8637594cf654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-148c84fd-f7a8-4229-ba4e-808cdfde0761', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12754fbc-3e2b-4429-b785-070c4742d9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:17 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Volume volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 (148c84fd-f7a8-4229-ba4e-808cdfde0761): created successfully Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12754fbc-3e2b-4429-b785-070c4742d9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:17 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Flow 'volume_create_manager' (c6b1f345-f990-4f07-b073-6a7e50c16b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-55254063-e248-48d5-9998-92d2a1e6da73 tempest-ProjectReaderTests-1296488993 None] Created volume successfully. Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "cinder-148c84fd-f7a8-4229-ba4e-808cdfde0761-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-148c84fd-f7a8-4229-ba4e-808cdfde0761-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "cinder-quobyte-148c84fd-f7a8-4229-ba4e-808cdfde0761" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-quobyte-148c84fd-f7a8-4229-ba4e-808cdfde0761" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b0570-48ff-4374-81a4-f7bef19ec7f4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:18 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 Sep 09 18:05:18 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:18 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761" returned: 0 in 0.367s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:18 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761 Sep 09 18:05:18 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:18 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-148c84fd-f7a8-4229-ba4e-808cdfde0761" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-quobyte-148c84fd-f7a8-4229-ba4e-808cdfde0761" released by "delete_volume" :: held 0.655s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Created reservations ['a8b99737-55a1-480d-96d2-8accbfe70834', 'b5e29d0f-b7f6-452a-b7c0-cab6445a911f', 'f2ad9e12-50ed-42ec-ab81-0d4898a3e1da', '3fd265e5-11d7-497d-9148-3fde861979e6'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:18 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:18 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:19 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.244s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:19 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Deleted volume successfully. Sep 09 18:05:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-477de587-50f8-4b9d-82e9-dedde7f72371 tempest-ProjectReaderTests-1296488993 None] Lock "cinder-148c84fd-f7a8-4229-ba4e-808cdfde0761-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:28 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=42,cinder:SELECT=28,cinder:DELETE=4,cinder:INSERT=10 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:05:29 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=28,cinder:UPDATE=46,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (ab7c0a4b-86a2-499f-9c69-f51f9ed14c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38fcc67-43ba-4b62-8927-0bcc54944961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38fcc67-43ba-4b62-8927-0bcc54944961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834114269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfa62d2-e442-4c2b-91b8-1ec87a040485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:31Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb76b44-466a-4cda-856b-e549c0ecc4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb76b44-466a-4cda-856b-e549c0ecc4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c051edc-ddf8-4e11-997d-040ea36fec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c051edc-ddf8-4e11-997d-040ea36fec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcfa62d2-e442-4c2b-91b8-1ec87a040485', 'volume_name': 'volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41b0fa5-4b77-4bd5-a4df-c613a51536e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41b0fa5-4b77-4bd5-a4df-c613a51536e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe790de-0f7e-4f3e-9bdf-4f36b81ede65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:30 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume dcfa62d2-e442-4c2b-91b8-1ec87a040485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485', 'volume_size': 1} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834114269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfa62d2-e442-4c2b-91b8-1ec87a040485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:31Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Creating volume dcfa62d2-e442-4c2b-91b8-1ec87a040485 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:30 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:30 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 1073741824 Sep 09 18:05:30 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:31 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 1073741824" returned: 0 in 0.591s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:31 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 Sep 09 18:05:31 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Flow 'volume_create_manager' (1b75cb3e-29bd-457f-b1a8-8900cfb56519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c00a1b-c6ff-438f-979e-423c4c3b47b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c00a1b-c6ff-438f-979e-423c4c3b47b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-694932892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9285ee74-543b-485d-a74b-d510ef0da655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4823202bd04f109aa31ca636a0e504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:31Z,use_quota=True,user_id='f730a1dd493d4ae095ab898b798e61c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a164498-1d90-4843-aef1-f1d011ca048f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a164498-1d90-4843-aef1-f1d011ca048f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ab9290-f2bf-4bfd-a70c-6bdd853074e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ab9290-f2bf-4bfd-a70c-6bdd853074e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9285ee74-543b-485d-a74b-d510ef0da655', 'volume_name': 'volume-9285ee74-543b-485d-a74b-d510ef0da655', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c7f585-0be6-4147-9897-7d7cd336ba95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c7f585-0be6-4147-9897-7d7cd336ba95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da167a0-fba0-4a51-886e-b549391d7d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Volume 9285ee74-543b-485d-a74b-d510ef0da655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9285ee74-543b-485d-a74b-d510ef0da655', 'volume_size': 1} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485" returned: 0 in 0.387s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-694932892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9285ee74-543b-485d-a74b-d510ef0da655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4823202bd04f109aa31ca636a0e504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:31Z,use_quota=True,user_id='f730a1dd493d4ae095ab898b798e61c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Creating volume 9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:31 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:31 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 1073741824 Sep 09 18:05:31 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (4aae14b0-c065-4f88-abd1-4240471baaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185ff4ed-7e9c-4e35-9cdc-ffc2e08b0586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185ff4ed-7e9c-4e35-9cdc-ffc2e08b0586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1974964523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143abcc0-d922-47b2-8076-5464d789e7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:32Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d15242-f94f-4c58-950c-b85a4224a8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d15242-f94f-4c58-950c-b85a4224a8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8f2f7c-46b2-4411-bb9b-b188f00ee4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8f2f7c-46b2-4411-bb9b-b188f00ee4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143abcc0-d922-47b2-8076-5464d789e7d1', 'volume_name': 'volume-143abcc0-d922-47b2-8076-5464d789e7d1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9349f74-54e1-4b6a-915b-d0896f0baec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9349f74-54e1-4b6a-915b-d0896f0baec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09a4677-8877-483f-badf-d2b44eb8f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Volume 143abcc0-d922-47b2-8076-5464d789e7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143abcc0-d922-47b2-8076-5464d789e7d1', 'volume_size': 1} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe790de-0f7e-4f3e-9bdf-4f36b81ede65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d88036-51e3-4b64-b8ba-322607c13af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:31 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 (dcfa62d2-e442-4c2b-91b8-1ec87a040485): created successfully Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d88036-51e3-4b64-b8ba-322607c13af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (ab7c0a4b-86a2-499f-9c69-f51f9ed14c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:32 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ed8c14f7-d45b-4728-9a82-5246cec0e98e tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created volume successfully. Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (727cc323-baa9-4904-bf5f-63258c150f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31ece6a-1928-482b-8577-d56e54d43e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31ece6a-1928-482b-8577-d56e54d43e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612711874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7c01d4-e1c1-41fb-b534-8aead640cd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:32Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb68d46-faf8-448a-91fd-8da279b00fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb68d46-faf8-448a-91fd-8da279b00fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430c1b32-3053-4dde-811d-826732b6dddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430c1b32-3053-4dde-811d-826732b6dddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f7c01d4-e1c1-41fb-b534-8aead640cd2c', 'volume_name': 'volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983aba68-a311-4834-a803-22d057e152c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983aba68-a311-4834-a803-22d057e152c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3368bbaf-c492-486c-892d-a63bacac3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Volume 0f7c01d4-e1c1-41fb-b534-8aead640cd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c', 'volume_size': 1} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (78db8381-4def-49d2-99dc-17bd99445a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e060b362-640a-4b38-bb2a-daeeb2ddc30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e060b362-640a-4b38-bb2a-daeeb2ddc30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-579393899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:32Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4916b2ee-9b31-4d70-9478-09a7b8897b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4916b2ee-9b31-4d70-9478-09a7b8897b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef62a7-f6e0-46b5-8b7c-c3959d57ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef62a7-f6e0-46b5-8b7c-c3959d57ce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9', 'volume_name': 'volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fce8d7-f4e1-401d-9946-d36d0096a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fce8d7-f4e1-401d-9946-d36d0096a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2454c9-fc8b-4fd7-8ef0-1963eb3cc85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Volume 732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9', 'volume_size': 1} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 1073741824" returned: 0 in 0.718s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:32 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 Sep 09 18:05:32 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:32 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (be69a4b2-65f9-4b24-93ad-c6126ce4860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2df6545-7d26-44fe-bf51-375ff600b6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655" returned: 0 in 0.369s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1974964523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143abcc0-d922-47b2-8076-5464d789e7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:32Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Creating volume 143abcc0-d922-47b2-8076-5464d789e7d1 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:32 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da167a0-fba0-4a51-886e-b549391d7d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9285ee74-543b-485d-a74b-d510ef0da655', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b82b62-f749-4d49-93d5-59b3efcedbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 1073741824 Sep 09 18:05:33 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2df6545-7d26-44fe-bf51-375ff600b6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-603567747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06704870-a16b-4b21-b8b1-6fab9e567692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:33Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7be0b5-a812-426e-93ba-2b8ff354e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7be0b5-a812-426e-93ba-2b8ff354e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e39932-891a-4312-a1d0-bc9a371bd397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e39932-891a-4312-a1d0-bc9a371bd397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06704870-a16b-4b21-b8b1-6fab9e567692', 'volume_name': 'volume-06704870-a16b-4b21-b8b1-6fab9e567692', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c14d15d-5629-4079-acba-8e4a17f54e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c14d15d-5629-4079-acba-8e4a17f54e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1c7fd0-408f-447e-9546-baf635b0eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Volume 06704870-a16b-4b21-b8b1-6fab9e567692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06704870-a16b-4b21-b8b1-6fab9e567692', 'volume_size': 1} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Volume volume-9285ee74-543b-485d-a74b-d510ef0da655 (9285ee74-543b-485d-a74b-d510ef0da655): created successfully Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b82b62-f749-4d49-93d5-59b3efcedbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Flow 'volume_create_manager' (1b75cb3e-29bd-457f-b1a8-8900cfb56519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-770fc912-21df-4876-980e-9962c9abe86d tempest-VolumeDependencyTests-764176673 None] Created volume successfully. Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (d7f7ec47-873a-40fa-bf6e-7ee6e6fd1a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040509b3-fc31-4c63-9079-901a419ea84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040509b3-fc31-4c63-9079-901a419ea84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004487133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad588de3-c8d4-4417-819f-4208de17ab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:33Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cbd981-c701-41a0-a2b5-301d9e824d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cbd981-c701-41a0-a2b5-301d9e824d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9b6aee-0ac3-48b8-a737-d1efd38b49da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9b6aee-0ac3-48b8-a737-d1efd38b49da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad588de3-c8d4-4417-819f-4208de17ab37', 'volume_name': 'volume-ad588de3-c8d4-4417-819f-4208de17ab37', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377bb1c0-dc70-4457-9a0b-f52ec585b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377bb1c0-dc70-4457-9a0b-f52ec585b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc12d35a-85c1-4c43-a2a2-82f14ef713f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Volume ad588de3-c8d4-4417-819f-4208de17ab37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad588de3-c8d4-4417-819f-4208de17ab37', 'volume_size': 1} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:33 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 1073741824" returned: 0 in 0.614s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:33 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 Sep 09 18:05:33 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:33 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1" returned: 0 in 0.273s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.707s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612711874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f7c01d4-e1c1-41fb-b534-8aead640cd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:32Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Creating volume 0f7c01d4-e1c1-41fb-b534-8aead640cd2c {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:33 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09a4677-8877-483f-badf-d2b44eb8f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143abcc0-d922-47b2-8076-5464d789e7d1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c 1073741824 Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881d3821-8858-4a2d-89b8-faccb4f52f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:33 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Volume volume-143abcc0-d922-47b2-8076-5464d789e7d1 (143abcc0-d922-47b2-8076-5464d789e7d1): created successfully Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881d3821-8858-4a2d-89b8-faccb4f52f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (4aae14b0-c065-4f88-abd1-4240471baaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2f783139-772b-483d-afd8-b1e664d67071 tempest-CreateVolumesFromImageTest-897933379 None] Created volume successfully. Sep 09 18:05:34 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c 1073741824" returned: 0 in 0.478s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:34 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c Sep 09 18:05:34 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:34 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-579393899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:32Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Creating volume 732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:34 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3368bbaf-c492-486c-892d-a63bacac3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:34 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 1073741824 Sep 09 18:05:34 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1f2fce-c87b-482a-9ed7-f3fb1756e6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:34 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Volume volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c (0f7c01d4-e1c1-41fb-b534-8aead640cd2c): created successfully Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1f2fce-c87b-482a-9ed7-f3fb1756e6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (727cc323-baa9-4904-bf5f-63258c150f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-db71c5f9-25db-48af-b70e-f5489d62d3e2 tempest-CreateVolumesFromImageTest-897933379 None] Created volume successfully. Sep 09 18:05:35 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 1073741824" returned: 0 in 0.462s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:35 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 Sep 09 18:05:35 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:35 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9" returned: 0 in 0.264s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.380s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-603567747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06704870-a16b-4b21-b8b1-6fab9e567692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:33Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Creating volume 06704870-a16b-4b21-b8b1-6fab9e567692 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:35 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2454c9-fc8b-4fd7-8ef0-1963eb3cc85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:35 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 1073741824 Sep 09 18:05:35 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c7689a-97fe-4a8c-81d5-1ed9aaaa78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:35 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Volume volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 (732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9): created successfully Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c7689a-97fe-4a8c-81d5-1ed9aaaa78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (78db8381-4def-49d2-99dc-17bd99445a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-25312a81-dd95-4e2f-aa14-0911c1fbdf46 tempest-CreateVolumesFromImageTest-897933379 None] Created volume successfully. Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Flow 'volume_create_manager' (a36d5564-5461-4c92-b2cd-0c525dc521d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9214d77e-a1f7-41e8-8565-1083f73433ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9214d77e-a1f7-41e8-8565-1083f73433ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75bd2e2-28f0-458f-b962-c122e9006427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aca7e3ed42c45f086aaaf4dc6954e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:36Z,use_quota=True,user_id='82f989f6351643238d20f470a0ca0da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e92722-2836-49e8-8f78-bf0854c467e8),volume_type_id=f6e92722-2836-49e8-8f78-bf0854c467e8)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8caccab1-0540-4210-96d8-40ddd24668ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8caccab1-0540-4210-96d8-40ddd24668ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7cf27d-139b-4346-abfb-f65df2cfab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7cf27d-139b-4346-abfb-f65df2cfab0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c75bd2e2-28f0-458f-b962-c122e9006427', 'volume_name': 'volume-c75bd2e2-28f0-458f-b962-c122e9006427', 'volume_size': 1, 'image_id': 'ff713e31-fc26-481a-ba82-f731b324300f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff713e31-fc26-481a-ba82-f731b324300f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f9dd584f14e46a78131396b6785e601', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3aca7e3ed42c45f086aaaf4dc6954e6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3a3dd0be326e414a36752b92ab1ed8928a833320a7b95137dbe906d520e28aab2b97102f21fe072fa203b052c4b36767afed1e12a93bd9a9021e15cd09e750d', 'id': 'ff713e31-fc26-481a-ba82-f731b324300f', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff713e31-fc26-481a-ba82-f731b324300f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b19dbc6-177c-4fcf-839f-9863deab51f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b19dbc6-177c-4fcf-839f-9863deab51f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b658ba1a-08ee-4de4-80e7-5384691e5a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:35 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Volume c75bd2e2-28f0-458f-b962-c122e9006427: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c75bd2e2-28f0-458f-b962-c122e9006427', 'volume_size': 1, 'image_id': 'ff713e31-fc26-481a-ba82-f731b324300f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff713e31-fc26-481a-ba82-f731b324300f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f9dd584f14e46a78131396b6785e601', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3aca7e3ed42c45f086aaaf4dc6954e6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3a3dd0be326e414a36752b92ab1ed8928a833320a7b95137dbe906d520e28aab2b97102f21fe072fa203b052c4b36767afed1e12a93bd9a9021e15cd09e750d', 'id': 'ff713e31-fc26-481a-ba82-f731b324300f', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff713e31-fc26-481a-ba82-f731b324300f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Trying to clone c75bd2e2-28f0-458f-b962-c122e9006427 from image ff713e31-fc26-481a-ba82-f731b324300f at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff713e31-fc26-481a-ba82-f731b324300f', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:05:35 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 1073741824" returned: 0 in 0.443s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:35 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 Sep 09 18:05:35 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:05:36 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Image download 0.00 MB at 0.00 MB/s Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c3bffc-f800-425e-9297-721a6377d53f]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:36 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD Sep 09 18:05:36 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:36 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692" returned: 0 in 0.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.783s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1c7fd0-408f-447e-9546-baf635b0eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06704870-a16b-4b21-b8b1-6fab9e567692', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6033c221-90c6-44b6-b1d1-c2796a3bb28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Creating offline snapshot caa7d341-a39c-4414-9a50-bda012507cb4 of volume dcfa62d2-e442-4c2b-91b8-1ec87a040485 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:05:36 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Volume volume-06704870-a16b-4b21-b8b1-6fab9e567692 (06704870-a16b-4b21-b8b1-6fab9e567692): created successfully Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6033c221-90c6-44b6-b1d1-c2796a3bb28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (be69a4b2-65f9-4b24-93ad-c6126ce4860a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e11111-119c-40d0-bd7f-dc615046c10c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:36 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a1bef928-d568-4b9f-b81e-66190450bd26 tempest-CreateVolumesFromImageTest-897933379 None] Created volume successfully. Sep 09 18:05:36 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:36 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 Sep 09 18:05:36 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:36 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD Sep 09 18:05:36 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:36 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485" returned: 0 in 0.381s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:36 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 1G Sep 09 18:05:36 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:36 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Temporary image ff713e31-fc26-481a-ba82-f731b324300f is fetched for user 82f989f6351643238d20f470a0ca0da4. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f68688-8538-49b9-9d89-8dbf67306a47]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:36 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD Sep 09 18:05:36 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:37 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 1G" returned: 0 in 0.409s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:37 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 Sep 09 18:05:37 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:37 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:37 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD Sep 09 18:05:37 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:37 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4" returned: 0 in 0.276s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:37 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 is being set with open permissions: ugo+rw Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:37 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 Sep 09 18:05:37 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:37 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:37 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:37 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.info Sep 09 18:05:37 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:37 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.info" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:37 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.info is being set with open permissions: ugo+rw Sep 09 18:05:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:37 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.info Sep 09 18:05:37 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:38 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.info" returned: 0 in 0.235s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.580s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004487133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad588de3-c8d4-4417-819f-4208de17ab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='504b0e6ad82b40328ed3f21460232062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:33Z,use_quota=True,user_id='5f9f8aa3b6284f8e934a3ed1e07b02d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Creating volume ad588de3-c8d4-4417-819f-4208de17ab37 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:38 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:38 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 1073741824 Sep 09 18:05:38 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2ebb4d49-de83-4595-9a96-73b796cbf8e6 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Create snapshot completed successfully Sep 09 18:05:38 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 1073741824" returned: 0 in 0.387s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:38 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 Sep 09 18:05:38 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:38 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37" returned: 0 in 0.292s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.079s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc12d35a-85c1-4c43-a2a2-82f14ef713f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad588de3-c8d4-4417-819f-4208de17ab37', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535bbc8c-bab0-48a2-950b-9deab6d3abcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Creating offline snapshot 59797aaa-f32c-474f-9082-e992e17104f9 of volume 9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:05:38 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Volume volume-ad588de3-c8d4-4417-819f-4208de17ab37 (ad588de3-c8d4-4417-819f-4208de17ab37): created successfully Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535bbc8c-bab0-48a2-950b-9deab6d3abcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Flow 'volume_create_manager' (d7f7ec47-873a-40fa-bf6e-7ee6e6fd1a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7bef05-3146-4aa2-8771-e7a02423d3dc]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-cbe2612e-0bb9-423d-b082-d6e82f68b141 tempest-CreateVolumesFromImageTest-897933379 None] Created volume successfully. Sep 09 18:05:38 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (5453eda3-6faf-486c-832c-c3bd6177cb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6086f7-3382-44f8-81fb-83f24b4287c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6086f7-3382-44f8-81fb-83f24b4287c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673845106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537f7008-8d2d-4cbc-9eb6-23a139872fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:39Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0793def2-3db7-4da8-adc7-3b3e3797c4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0793def2-3db7-4da8-adc7-3b3e3797c4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ff2086-9143-446c-867e-a26e0867f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ff2086-9143-446c-867e-a26e0867f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537f7008-8d2d-4cbc-9eb6-23a139872fb1', 'volume_name': 'volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d520bb5-5891-4bc2-8920-1ea8bc800b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 Sep 09 18:05:39 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d520bb5-5891-4bc2-8920-1ea8bc800b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d29af8e-fb40-444e-9e7d-5cfbc9de81b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume 537f7008-8d2d-4cbc-9eb6-23a139872fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1', 'volume_size': 1} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:39 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (3fdf02ed-5a0a-4e4e-93fb-abd252a79999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6af6f8-a34a-48c0-9fa3-57b21ca39aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655" returned: 0 in 0.423s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6af6f8-a34a-48c0-9fa3-57b21ca39aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161446473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7291f164-3d0f-474a-b318-6b74386c68f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:39Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 1G Sep 09 18:05:39 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3b8af1-e4d9-4338-947f-46467e889d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3b8af1-e4d9-4338-947f-46467e889d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e571608-3ffc-4b49-a08a-3f6c8c863d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e571608-3ffc-4b49-a08a-3f6c8c863d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7291f164-3d0f-474a-b318-6b74386c68f6', 'volume_name': 'volume-7291f164-3d0f-474a-b318-6b74386c68f6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d086d8-4d1c-45e2-acf1-94d8bbdbc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d086d8-4d1c-45e2-acf1-94d8bbdbc32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577c09bd-d55a-4fda-95c0-9de323736ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume 7291f164-3d0f-474a-b318-6b74386c68f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7291f164-3d0f-474a-b318-6b74386c68f6', 'volume_size': 1} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (63a2120d-3c05-4bda-81dd-6c395b4ae703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b121c63-147f-48e1-94a6-ba2d0e740c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b121c63-147f-48e1-94a6-ba2d0e740c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1765988271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10259f42-d305-4ed0-9076-1021e5a2bd46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:40Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1af7c2-9821-4086-a0cf-abfe33d06106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1af7c2-9821-4086-a0cf-abfe33d06106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59946d49-e690-41fb-9b48-40e3e70cd0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59946d49-e690-41fb-9b48-40e3e70cd0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10259f42-d305-4ed0-9076-1021e5a2bd46', 'volume_name': 'volume-10259f42-d305-4ed0-9076-1021e5a2bd46', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74836a0-4d30-4cf3-b635-e28b6904b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74836a0-4d30-4cf3-b635-e28b6904b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c7989e-8f36-4541-a1d6-748c02ec48c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:39 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume 10259f42-d305-4ed0-9076-1021e5a2bd46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10259f42-d305-4ed0-9076-1021e5a2bd46', 'volume_size': 1} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:39 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 1G" returned: 0 in 0.472s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9285ee74-543b-485d-a74b-d510ef0da655 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:39 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9285ee74-543b-485d-a74b-d510ef0da655 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 Sep 09 18:05:39 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-ad588de3-c8d4-4417-819f-4208de17ab37-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-ad588de3-c8d4-4417-819f-4208de17ab37-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-quobyte-ad588de3-c8d4-4417-819f-4208de17ab37" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (12f57e39-7612-441a-ba52-f20df7ceb994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc247e0-bb85-4d61-93c1-72cff22c0603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-ad588de3-c8d4-4417-819f-4208de17ab37" acquired by "delete_volume" :: waited 0.062s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc247e0-bb85-4d61-93c1-72cff22c0603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143985857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e3edfa-f8b0-4903-b923-ca04bcbd1637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:40Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6ea026-0599-4f41-bc1c-44d110c9af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6ea026-0599-4f41-bc1c-44d110c9af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:40 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a75b9d-02ef-46b2-a60c-43443a6395bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a75b9d-02ef-46b2-a60c-43443a6395bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e3edfa-f8b0-4903-b923-ca04bcbd1637', 'volume_name': 'volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cecf6bf-e9c9-48fa-bd49-e7a6c7eb5eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cecf6bf-e9c9-48fa-bd49-e7a6c7eb5eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499406d3-3124-4353-a2e5-a3262afaa049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume 50e3edfa-f8b0-4903-b923-ca04bcbd1637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637', 'volume_size': 1} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95021b8-4a2c-4b25-afc5-d27612d63a55]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9285ee74-543b-485d-a74b-d510ef0da655 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9" returned: 0 in 0.444s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:40 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 is being set with open permissions: ugo+rw Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:40 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 Sep 09 18:05:40 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:40 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 Sep 09 18:05:40 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (029bb322-9cc7-4365-bb4d-9d6781bc6e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a341a67e-b9d8-4167-adf5-b9c935679f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a341a67e-b9d8-4167-adf5-b9c935679f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989088104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d892c389-1e62-4942-bc66-fba3ddc73a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:40Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15c46cc-21d4-4246-9e84-e84b043ad987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15c46cc-21d4-4246-9e84-e84b043ad987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:40 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f25d2e2-95f0-4061-8a67-545abe6b8c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f25d2e2-95f0-4061-8a67-545abe6b8c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd892c389-1e62-4942-bc66-fba3ddc73a1f', 'volume_name': 'volume-d892c389-1e62-4942-bc66-fba3ddc73a1f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b8a42a-0695-4382-b2f8-c43ebc9d5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b8a42a-0695-4382-b2f8-c43ebc9d5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5101d98d-962c-4d44-8da8-c018c5f8c036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:40 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume d892c389-1e62-4942-bc66-fba3ddc73a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d892c389-1e62-4942-bc66-fba3ddc73a1f', 'volume_size': 1} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:40 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37" returned: 0 in 0.375s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:40 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37 Sep 09 18:05:40 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:40 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.info Sep 09 18:05:40 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:40 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ad588de3-c8d4-4417-819f-4208de17ab37" returned: 0 in 0.240s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-ad588de3-c8d4-4417-819f-4208de17ab37" released by "delete_volume" :: held 0.693s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:40 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.info" returned: 0 in 0.254s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:40 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.info is being set with open permissions: ugo+rw Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:40 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.info Sep 09 18:05:40 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:40 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Created reservations ['0536ce77-b462-40a1-84ae-2e64b33d8029', '62240deb-615d-4adc-90a4-835c6cd58f09', '540d7ef2-cb60-4f90-bd7c-ca98c3e47441', '902cba9c-b551-400a-a090-23271b59e13e'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:41 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:41 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:41 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.info" returned: 0 in 0.241s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.729s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75bd2e2-28f0-458f-b962-c122e9006427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aca7e3ed42c45f086aaaf4dc6954e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:36Z,use_quota=True,user_id='82f989f6351643238d20f470a0ca0da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e92722-2836-49e8-8f78-bf0854c467e8),volume_type_id=f6e92722-2836-49e8-8f78-bf0854c467e8)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Creating volume c75bd2e2-28f0-458f-b962-c122e9006427 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:41 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:41 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 1073741824 Sep 09 18:05:41 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-52e89e79-85bc-4f6b-9b7b-5fde1c59d93c tempest-VolumeDependencyTests-764176673 None] Create snapshot completed successfully Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-06704870-a16b-4b21-b8b1-6fab9e567692-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-06704870-a16b-4b21-b8b1-6fab9e567692-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-quobyte-06704870-a16b-4b21-b8b1-6fab9e567692" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-06704870-a16b-4b21-b8b1-6fab9e567692" acquired by "delete_volume" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:41 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.289s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Deleted volume successfully. Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbc6b93-93d0-49c3-a37b-6a349db8c583]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5eac9674-16ab-45d6-90c6-5b9220af9176 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-ad588de3-c8d4-4417-819f-4208de17ab37-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:41 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 Sep 09 18:05:41 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:41 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 1073741824" returned: 0 in 0.438s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:41 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 Sep 09 18:05:41 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:41 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692" returned: 0 in 0.386s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:41 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692 Sep 09 18:05:41 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:41 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673845106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537f7008-8d2d-4cbc-9eb6-23a139872fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:39Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Creating volume 537f7008-8d2d-4cbc-9eb6-23a139872fb1 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:41 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:41 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 1073741824 Sep 09 18:05:41 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:41 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Attempting download of ff713e31-fc26-481a-ba82-f731b324300f ((None, [{'url': 'file:///opt/stack/data/glance/images/ff713e31-fc26-481a-ba82-f731b324300f', 'metadata': {}}])) to volume c75bd2e2-28f0-458f-b962-c122e9006427. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e3f34-dd6c-478a-8fe5-81ec9aff1751]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff713e31-fc26-481a-ba82-f731b324300f_j5xevnko {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:42 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-06704870-a16b-4b21-b8b1-6fab9e567692" returned: 0 in 0.283s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-06704870-a16b-4b21-b8b1-6fab9e567692" released by "delete_volume" :: held 0.717s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Created reservations ['ad02c7be-f157-4b00-9785-c5a6acafa29f', '4004238b-3b73-4819-8d8a-433f273f5de4', '605c03bc-4072-4af5-8b4e-c6bcc882e4ce', '9c5c5e29-10bc-4e71-82d8-04dde6eb4007'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:42 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff713e31-fc26-481a-ba82-f731b324300f_j5xevnko Sep 09 18:05:42 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:42 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:42 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:42 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:42 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 1073741824" returned: 0 in 0.462s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff713e31-fc26-481a-ba82-f731b324300f_j5xevnko" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff713e31-fc26-481a-ba82-f731b324300f_j5xevnko {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:42 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.309s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:42 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 Sep 09 18:05:42 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Deleted volume successfully. Sep 09 18:05:42 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff713e31-fc26-481a-ba82-f731b324300f_j5xevnko Sep 09 18:05:42 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-25749274-394b-49c3-9f62-209a66340505 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-06704870-a16b-4b21-b8b1-6fab9e567692-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-quobyte-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66f8029-60a8-4b47-96cf-7d5c5e519837]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:42 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff713e31-fc26-481a-ba82-f731b324300f_j5xevnko" returned: 1 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff713e31-fc26-481a-ba82-f731b324300f_j5xevnko' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[532bb9b6-2b72-4dfe-9594-fd2a6bf9b8af]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:42 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.402s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161446473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7291f164-3d0f-474a-b318-6b74386c68f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:39Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Creating volume 7291f164-3d0f-474a-b318-6b74386c68f6 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:42 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:42 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 Sep 09 18:05:42 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d29af8e-fb40-444e-9e7d-5cfbc9de81b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:42 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 1073741824 Sep 09 18:05:42 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b211f528-81e8-4819-b951-c3ae8cef1c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:42 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 (537f7008-8d2d-4cbc-9eb6-23a139872fb1): created successfully Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b211f528-81e8-4819-b951-c3ae8cef1c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:42 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD Sep 09 18:05:42 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (5453eda3-6faf-486c-832c-c3bd6177cb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ad72910b-70dd-4deb-8b0f-19b291c6b97b tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created volume successfully. Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Flow 'volume_create_manager' (dea8edd8-9bf4-4927-a5d7-864c6be648bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a78dee-ebfc-4cf4-8465-7b4924c46176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a78dee-ebfc-4cf4-8465-7b4924c46176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-684710192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3198218e-3046-4623-ab4e-a088852f26b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4823202bd04f109aa31ca636a0e504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59797aaa-f32c-474f-9082-e992e17104f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:43Z,use_quota=True,user_id='f730a1dd493d4ae095ab898b798e61c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ffacb5-40aa-4225-97f8-dacc7562a4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ffacb5-40aa-4225-97f8-dacc7562a4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb17f35-780d-4745-a102-ea70ee910f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb17f35-780d-4745-a102-ea70ee910f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3198218e-3046-4623-ab4e-a088852f26b6', 'volume_name': 'volume-3198218e-3046-4623-ab4e-a088852f26b6', 'volume_size': 1, 'snapshot_id': '59797aaa-f32c-474f-9082-e992e17104f9'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985abe81-4db5-4918-b2cf-30777dc3978d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985abe81-4db5-4918-b2cf-30777dc3978d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2889e4-7e44-4d99-99ce-44ce3fd739a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:43 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Volume 3198218e-3046-4623-ab4e-a088852f26b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3198218e-3046-4623-ab4e-a088852f26b6', 'volume_size': 1, 'snapshot_id': '59797aaa-f32c-474f-9082-e992e17104f9'} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:43 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:43 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9" returned: 0 in 0.549s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:43 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9 Sep 09 18:05:43 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:43 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD Sep 09 18:05:43 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:43 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 1073741824" returned: 0 in 0.529s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:43 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 Sep 09 18:05:43 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:43 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9" returned: 0 in 0.282s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9" released by "delete_volume" :: held 0.898s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:43 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] ff713e31-fc26-481a-ba82-f731b324300f was raw, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:43 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 Sep 09 18:05:43 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Created reservations ['48504b9e-53ad-4ead-9201-2c75073fa77e', 'ae4f2d47-2348-437d-b3b6-25465f92f22f', 'f2edaf7d-519d-4089-b763-1a8e7aafd2fd', '43a9dec5-7ff1-4e53-b1f7-20ff40422b4f'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:43 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6" returned: 0 in 0.281s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.921s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1765988271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10259f42-d305-4ed0-9076-1021e5a2bd46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:40Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Creating volume 10259f42-d305-4ed0-9076-1021e5a2bd46 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:43 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:43 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:43 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:43 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 1073741824 Sep 09 18:05:43 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577c09bd-d55a-4fda-95c0-9de323736ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7291f164-3d0f-474a-b318-6b74386c68f6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a66828-c3df-40ea-ae60-3ea17e53b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:43 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume volume-7291f164-3d0f-474a-b318-6b74386c68f6 (7291f164-3d0f-474a-b318-6b74386c68f6): created successfully Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a66828-c3df-40ea-ae60-3ea17e53b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (3fdf02ed-5a0a-4e4e-93fb-abd252a79999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:43 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6528babc-211c-4baf-9e45-b7d32a3ab334 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created volume successfully. Sep 09 18:05:43 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.297s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:43 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:44 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Deleted volume successfully. Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d9c972bf-52b8-4b60-9ec2-92a2088be268 tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-732a72d5-9bd0-4ad6-8f39-a949b8d5e7c9-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:44 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427" returned: 0 in 0.629s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff713e31-fc26-481a-ba82-f731b324300f_p76kayxodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:05:44 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:44 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 1G Sep 09 18:05:44 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:44 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 1073741824" returned: 0 in 0.532s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:44 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 Sep 09 18:05:44 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:44 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 1G" returned: 0 in 0.317s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Downloaded image ff713e31-fc26-481a-ba82-f731b324300f ((None, [{'url': 'file:///opt/stack/data/glance/images/ff713e31-fc26-481a-ba82-f731b324300f', 'metadata': {}}])) to volume c75bd2e2-28f0-458f-b962-c122e9006427 successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Temporary image ff713e31-fc26-481a-ba82-f731b324300f for user 82f989f6351643238d20f470a0ca0da4 is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Marking volume c75bd2e2-28f0-458f-b962-c122e9006427 as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Copying metadata from image ff713e31-fc26-481a-ba82-f731b324300f to c75bd2e2-28f0-458f-b962-c122e9006427. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Creating volume glance metadata for volume c75bd2e2-28f0-458f-b962-c122e9006427 backed by image ff713e31-fc26-481a-ba82-f731b324300f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ff713e31-fc26-481a-ba82-f731b324300f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1f9dd584f14e46a78131396b6785e601', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:05:44 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.275s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143985857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e3edfa-f8b0-4903-b923-ca04bcbd1637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:40Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Creating volume 50e3edfa-f8b0-4903-b923-ca04bcbd1637 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:44 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:44 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 1073741824 Sep 09 18:05:44 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c7989e-8f36-4541-a1d6-748c02ec48c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10259f42-d305-4ed0-9076-1021e5a2bd46', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd56b628-bf41-439c-b4f2-74574bfe04df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:44 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume volume-10259f42-d305-4ed0-9076-1021e5a2bd46 (10259f42-d305-4ed0-9076-1021e5a2bd46): created successfully Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd56b628-bf41-439c-b4f2-74574bfe04df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (63a2120d-3c05-4bda-81dd-6c395b4ae703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b658ba1a-08ee-4de4-80e7-5384691e5a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75bd2e2-28f0-458f-b962-c122e9006427', 'volume_size': 1, 'image_id': 'ff713e31-fc26-481a-ba82-f731b324300f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff713e31-fc26-481a-ba82-f731b324300f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f9dd584f14e46a78131396b6785e601', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3aca7e3ed42c45f086aaaf4dc6954e6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd3a3dd0be326e414a36752b92ab1ed8928a833320a7b95137dbe906d520e28aab2b97102f21fe072fa203b052c4b36767afed1e12a93bd9a9021e15cd09e750d', 'id': 'ff713e31-fc26-481a-ba82-f731b324300f', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff713e31-fc26-481a-ba82-f731b324300f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ea7639-b734-4dbb-bfeb-5fc9afbce352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:44 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-35bcf969-a68e-4f10-970d-21014202f497 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created volume successfully. Sep 09 18:05:44 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Volume volume-c75bd2e2-28f0-458f-b962-c122e9006427 (c75bd2e2-28f0-458f-b962-c122e9006427): created successfully Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ea7639-b734-4dbb-bfeb-5fc9afbce352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Flow 'volume_create_manager' (a36d5564-5461-4c92-b2cd-0c525dc521d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:44 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-30fa3a11-4a09-4d8d-a6b2-7b0414b7a2f5 tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Created volume successfully. Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-0f7c01d4-e1c1-41fb-b534-8aead640cd2c-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-0f7c01d4-e1c1-41fb-b534-8aead640cd2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-quobyte-0f7c01d4-e1c1-41fb-b534-8aead640cd2c" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-0f7c01d4-e1c1-41fb-b534-8aead640cd2c" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee59c8b7-cbfc-4c8a-a755-5a053e55090c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:44 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c Sep 09 18:05:44 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:45 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 1073741824" returned: 0 in 0.524s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:45 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 Sep 09 18:05:45 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Acquiring lock "cinder-c75bd2e2-28f0-458f-b962-c122e9006427-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:45 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "cinder-c75bd2e2-28f0-458f-b962-c122e9006427-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c" returned: 0 in 0.414s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:45 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c Sep 09 18:05:45 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Acquiring lock "cinder-quobyte-c75bd2e2-28f0-458f-b962-c122e9006427" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "cinder-quobyte-c75bd2e2-28f0-458f-b962-c122e9006427" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5475083-0889-48b9-b7b9-f8a67eaf9582]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:45 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637" returned: 0 in 0.259s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.757s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989088104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d892c389-1e62-4942-bc66-fba3ddc73a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a97933053cd46a1b5b1949e49ff4d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:40Z,use_quota=True,user_id='2e70e056a5a34b1c8b3b66c151af0695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Creating volume d892c389-1e62-4942-bc66-fba3ddc73a1f {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:45 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:45 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f 1073741824 Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499406d3-3124-4353-a2e5-a3262afaa049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:45 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff638c39-3fc9-4e16-8fdf-68289896d786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:45 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 (50e3edfa-f8b0-4903-b923-ca04bcbd1637): created successfully Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff638c39-3fc9-4e16-8fdf-68289896d786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (12f57e39-7612-441a-ba52-f20df7ceb994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-aaa0adf5-7360-467f-9519-235febcb3c0d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created volume successfully. Sep 09 18:05:45 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 Sep 09 18:05:45 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:45 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0f7c01d4-e1c1-41fb-b534-8aead640cd2c" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-0f7c01d4-e1c1-41fb-b534-8aead640cd2c" released by "delete_volume" :: held 0.745s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Created reservations ['b51f0684-65a2-423f-ac8a-3285172421c4', 'eb7bdbfd-1f48-4e26-ae55-3069a42c063b', 'f4288bba-44f1-4a55-b111-4f99f0fd97de', '03745b86-6bd7-4f6c-ac2b-a28afe4c0191'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:45 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:45 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:45 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427" returned: 0 in 0.416s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:45 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427 Sep 09 18:05:45 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:45 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f 1073741824" returned: 0 in 0.502s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-143abcc0-d922-47b2-8076-5464d789e7d1-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:45 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-143abcc0-d922-47b2-8076-5464d789e7d1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:45 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f Sep 09 18:05:45 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:46 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.328s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Deleted volume successfully. Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "cinder-quobyte-143abcc0-d922-47b2-8076-5464d789e7d1" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-2d64fc1a-f215-4084-a643-f21440d05bab tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-0f7c01d4-e1c1-41fb-b534-8aead640cd2c-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-143abcc0-d922-47b2-8076-5464d789e7d1" acquired by "delete_volume" :: waited 0.035s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[722c533d-6575-40e1-ab70-2e1deee87b46]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:46 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c75bd2e2-28f0-458f-b962-c122e9006427" returned: 0 in 0.376s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "cinder-quobyte-c75bd2e2-28f0-458f-b962-c122e9006427" released by "delete_volume" :: held 0.833s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Created reservations ['a57af812-4ed7-4065-843a-de82c16ab162', '32c7521f-d9de-41b1-94b6-9835a7db3587', '33ed0643-d7b5-46a6-ae82-e2266a5cdca4', '23164c6d-5766-481e-910c-eb69720d2fb3'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:46 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 Sep 09 18:05:46 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:46 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f" returned: 0 in 0.312s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.127s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-quobyte-59797aaa-f32c-474f-9082-e992e17104f9-3198218e-3046-4623-ab4e-a088852f26b6" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5101d98d-962c-4d44-8da8-c018c5f8c036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d892c389-1e62-4942-bc66-fba3ddc73a1f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321aadac-600e-495a-b176-7f5129916d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-59797aaa-f32c-474f-9082-e992e17104f9-3198218e-3046-4623-ab4e-a088852f26b6" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Creating volume 3198218e-3046-4623-ab4e-a088852f26b6 from snapshot 59797aaa-f32c-474f-9082-e992e17104f9 {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-quobyte-3198218e-3046-4623-ab4e-a088852f26b6" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Volume volume-d892c389-1e62-4942-bc66-fba3ddc73a1f (d892c389-1e62-4942-bc66-fba3ddc73a1f): created successfully Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321aadac-600e-495a-b176-7f5129916d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Flow 'volume_create_manager' (029bb322-9cc7-4365-bb4d-9d6781bc6e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:46 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:46 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-3198218e-3046-4623-ab4e-a088852f26b6" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] snapshot: 59797aaa-f32c-474f-9082-e992e17104f9, volume: 3198218e-3046-4623-ab4e-a088852f26b6, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:05:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8e64825d-9b80-4384-bc0a-5e617696adbd tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created volume successfully. Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[35037e19-b7ba-4737-aa4e-f81b4d93777e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:46 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1" returned: 0 in 0.419s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:46 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1 Sep 09 18:05:46 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:46 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 Sep 09 18:05:46 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:46 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.337s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Deleted volume successfully. Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-204386bb-b1d4-4eaf-a814-44cbf470a94f tempest-VolumeAndVolumeTypeFromImageTest-2140123936 None] Lock "cinder-c75bd2e2-28f0-458f-b962-c122e9006427-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:46 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-143abcc0-d922-47b2-8076-5464d789e7d1" returned: 0 in 0.318s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-quobyte-143abcc0-d922-47b2-8076-5464d789e7d1" released by "delete_volume" :: held 0.781s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:46 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9" returned: 0 in 0.437s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9285ee74-543b-485d-a74b-d510ef0da655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a677e5-b679-4d99-aa7a-6232483d7f5a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:46 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Created reservations ['7c046d05-3850-46a4-bcac-e9f2c68a82f6', '169a7158-19ef-41ec-a835-19772bd46a92', 'd058211b-b643-4dcc-86c7-c16766198675', '1ddb1b4a-0057-41f3-ad2d-426915b44730'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:47 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 Sep 09 18:05:47 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:47 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:47 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:47 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655" returned: 0 in 0.426s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:47 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.326s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:47 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 Sep 09 18:05:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Deleted volume successfully. Sep 09 18:05:47 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8997666-f50a-4f9d-933b-3eb734f9d83d tempest-CreateVolumesFromImageTest-897933379 None] Lock "cinder-143abcc0-d922-47b2-8076-5464d789e7d1-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-d892c389-1e62-4942-bc66-fba3ddc73a1f-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-d892c389-1e62-4942-bc66-fba3ddc73a1f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-quobyte-d892c389-1e62-4942-bc66-fba3ddc73a1f" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-d892c389-1e62-4942-bc66-fba3ddc73a1f" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd46d64-ee1d-4406-91d2-7958e014de35]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:47 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f Sep 09 18:05:47 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:48 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f" returned: 0 in 0.566s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:48 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f Sep 09 18:05:48 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:48 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-d892c389-1e62-4942-bc66-fba3ddc73a1f" returned: 0 in 0.586s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-d892c389-1e62-4942-bc66-fba3ddc73a1f" released by "delete_volume" :: held 1.236s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:48 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created reservations ['a92e44c7-ddbf-4fe0-8a32-fa025d70c0e4', 'c05750bb-8105-4a8c-8340-7520976e33ad', 'af1ff5fb-c9d9-40fc-9014-8d7ce2b2c0cf', '58b2fd7c-e0f5-46e8-8b01-6e8e938e27e8'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:49 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:49 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:49 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.612s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:49 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Deleted volume successfully. Sep 09 18:05:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e5f4e6c4-e74b-404d-bd78-5285952b307a tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-d892c389-1e62-4942-bc66-fba3ddc73a1f-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-50e3edfa-f8b0-4903-b923-ca04bcbd1637-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-50e3edfa-f8b0-4903-b923-ca04bcbd1637-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-quobyte-50e3edfa-f8b0-4903-b923-ca04bcbd1637" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:50 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-50e3edfa-f8b0-4903-b923-ca04bcbd1637" acquired by "delete_volume" :: waited 0.038s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:50 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fac4b3-9040-4f04-a263-be8aeb9f9786]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:50 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:50 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 Sep 09 18:05:50 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:51 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637" returned: 0 in 0.910s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:51 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637 Sep 09 18:05:51 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:51 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-50e3edfa-f8b0-4903-b923-ca04bcbd1637" returned: 0 in 0.650s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-50e3edfa-f8b0-4903-b923-ca04bcbd1637" released by "delete_volume" :: held 1.712s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created reservations ['350bb1e9-c54b-4e07-9af0-86bdbc1e9b27', '9c91d4a4-f0ea-4137-899e-f2db253aac8a', 'e12682f1-fac9-4217-8623-aee02e06a26e', 'e127e766-0a8a-47a3-b8ea-be7f91906738'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:52 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:52 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-10259f42-d305-4ed0-9076-1021e5a2bd46-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-10259f42-d305-4ed0-9076-1021e5a2bd46-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-quobyte-10259f42-d305-4ed0-9076-1021e5a2bd46" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-10259f42-d305-4ed0-9076-1021e5a2bd46" acquired by "delete_volume" :: waited 0.068s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[74803b18-a58a-4038-8753-4b07b3feca86]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:53 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.745s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Deleted volume successfully. Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d73b8d09-c97b-483a-8fd2-0e0b60c86eca tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-50e3edfa-f8b0-4903-b923-ca04bcbd1637-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:53 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 Sep 09 18:05:53 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:53 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6" returned: 0 in 6.372s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:05:53 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Converted 1024.00 MB image at 160.68 MB/s Sep 09 18:05:53 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 is being set with open permissions: ugo+rw Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:53 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46" returned: 0 in 0.574s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:53 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 Sep 09 18:05:53 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:53 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46 Sep 09 18:05:53 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:54 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-10259f42-d305-4ed0-9076-1021e5a2bd46" returned: 0 in 0.335s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-10259f42-d305-4ed0-9076-1021e5a2bd46" released by "delete_volume" :: held 1.006s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:54 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6" returned: 0 in 0.402s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-3198218e-3046-4623-ab4e-a088852f26b6" released by "_copy_volume_from_snapshot" :: held 7.751s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created reservations ['cb268ba0-7e5a-4cd8-a43b-e81fe2509ad3', 'ecad5edc-3de8-4ab3-94a8-9a376d03300f', '510cb4cd-f188-4d29-97d8-8252016368c8', '0de4d7f7-ae2e-4de5-921a-c34a3ba7b4b1'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-59797aaa-f32c-474f-9082-e992e17104f9-3198218e-3046-4623-ab4e-a088852f26b6" released by "_create_volume_from_snapshot" :: held 7.884s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.920s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2889e4-7e44-4d99-99ce-44ce3fd739a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3198218e-3046-4623-ab4e-a088852f26b6', 'volume_size': 1, 'snapshot_id': '59797aaa-f32c-474f-9082-e992e17104f9'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e473eb6-7586-4606-9ed7-f78101c45f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:54 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Volume volume-3198218e-3046-4623-ab4e-a088852f26b6 (3198218e-3046-4623-ab4e-a088852f26b6): created successfully Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e473eb6-7586-4606-9ed7-f78101c45f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Flow 'volume_create_manager' (dea8edd8-9bf4-4927-a5d7-864c6be648bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:54 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:54 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (c4183e16-9e55-40e5-8f5d-e51d8a8ca529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bf42a3-2445-423c-9b29-1c2abe6f215d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d28d6382-55b1-4658-843d-dff566443595 tempest-VolumeDependencyTests-764176673 None] Created volume successfully. Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bf42a3-2445-423c-9b29-1c2abe6f215d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746263523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:54Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e49f9b4-77e0-4b2d-88df-00f0ee461ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e49f9b4-77e0-4b2d-88df-00f0ee461ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed93d9f-adcf-488d-a4c0-6d80c23aa7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed93d9f-adcf-488d-a4c0-6d80c23aa7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac', 'volume_name': 'volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6842951b-0598-4d98-ad4d-50a2235965e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6842951b-0598-4d98-ad4d-50a2235965e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47858713-4f7c-4f97-ab86-c1ea80873c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:54 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume 0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac', 'volume_size': 1} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746263523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:54Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Creating volume 0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:54 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:54 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac 1073741824 Sep 09 18:05:54 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:54 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.293s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Deleted volume successfully. Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcd798cd-db0d-47e7-9346-edaaf8836342 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-10259f42-d305-4ed0-9076-1021e5a2bd46-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:54 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac 1073741824" returned: 0 in 0.471s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:54 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac Sep 09 18:05:54 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-7291f164-3d0f-474a-b318-6b74386c68f6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-7291f164-3d0f-474a-b318-6b74386c68f6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-quobyte-7291f164-3d0f-474a-b318-6b74386c68f6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:55 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-7291f164-3d0f-474a-b318-6b74386c68f6" acquired by "delete_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac" returned: 0 in 0.314s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47858713-4f7c-4f97-ab86-c1ea80873c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac544e2-c767-4482-a513-0c5c1de2c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[da66d13d-19c3-4d38-8e55-353080958c82]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:55 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac (0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac): created successfully Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac544e2-c767-4482-a513-0c5c1de2c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (c4183e16-9e55-40e5-8f5d-e51d8a8ca529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-23c3f584-d76c-48d3-b016-c893856e7103 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created volume successfully. Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-59797aaa-f32c-474f-9082-e992e17104f9-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-59797aaa-f32c-474f-9082-e992e17104f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-quobyte-9285ee74-543b-485d-a74b-d510ef0da655" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-9285ee74-543b-485d-a74b-d510ef0da655" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-quobyte-59797aaa-f32c-474f-9082-e992e17104f9" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-59797aaa-f32c-474f-9082-e992e17104f9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Deleting offline snapshot 59797aaa-f32c-474f-9082-e992e17104f9 of volume 9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:05:55 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 Sep 09 18:05:55 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] snapshot_file for this snap is: volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf025ed-12ac-4845-a647-fda377bb58e3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:55 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 Sep 09 18:05:55 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:55 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6" returned: 0 in 0.423s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:55 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6 Sep 09 18:05:55 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:55 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9" returned: 0 in 0.404s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9285ee74-543b-485d-a74b-d510ef0da655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[62635e04-53f9-4f3e-b471-d9b8eea388a1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:55 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7291f164-3d0f-474a-b318-6b74386c68f6" returned: 0 in 0.288s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:56 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-7291f164-3d0f-474a-b318-6b74386c68f6" released by "delete_volume" :: held 0.774s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:56 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created reservations ['578b65f2-bc4a-4bb1-aa20-da295935e58f', 'f17b5855-77fa-4845-9365-40240ac115e9', 'e02527f2-8f1c-4e5a-b9db-b054e4aaddb6', 'cdb4d752-e156-440f-a8e3-7ad99e6e745b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:56 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:56 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-537f7008-8d2d-4cbc-9eb6-23a139872fb1-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-537f7008-8d2d-4cbc-9eb6-23a139872fb1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-quobyte-537f7008-8d2d-4cbc-9eb6-23a139872fb1" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-537f7008-8d2d-4cbc-9eb6-23a139872fb1" acquired by "delete_volume" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[678b787e-1f2d-4543-9dce-6b6924acd551]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:56 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.349s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Deleted volume successfully. Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-38de4bed-8028-4657-90d1-c766ce9961c2 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-7291f164-3d0f-474a-b318-6b74386c68f6-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:56 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655" returned: 0 in 0.748s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:56 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 Sep 09 18:05:56 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:56 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 Sep 09 18:05:56 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:57 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1" returned: 0 in 0.489s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:57 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1 Sep 09 18:05:57 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (a3e2e06a-3065-438b-ba63-1a1794b98ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483d9cf3-8755-4757-bd0f-970edbb21f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483d9cf3-8755-4757-bd0f-970edbb21f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997071674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f3923b-0061-4f82-9000-5529b16eb79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:57Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431a2c59-61ba-4a73-84ac-519b92377fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431a2c59-61ba-4a73-84ac-519b92377fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc7109d-15dc-4f65-b2e1-2321ec7923cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc7109d-15dc-4f65-b2e1-2321ec7923cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f3923b-0061-4f82-9000-5529b16eb79a', 'volume_name': 'volume-e1f3923b-0061-4f82-9000-5529b16eb79a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea050154-3381-46d3-ae59-9efcb1db4b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea050154-3381-46d3-ae59-9efcb1db4b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeafa2a8-22ec-4055-bc25-fc7bd3b776b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume e1f3923b-0061-4f82-9000-5529b16eb79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f3923b-0061-4f82-9000-5529b16eb79a', 'volume_size': 1} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997071674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f3923b-0061-4f82-9000-5529b16eb79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:57Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Creating volume e1f3923b-0061-4f82-9000-5529b16eb79a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:57 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:57 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9" returned: 0 in 0.576s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:57 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9 Sep 09 18:05:57 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a 1073741824 Sep 09 18:05:57 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:57 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:57 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-537f7008-8d2d-4cbc-9eb6-23a139872fb1" returned: 0 in 0.453s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-537f7008-8d2d-4cbc-9eb6-23a139872fb1" released by "delete_volume" :: held 1.035s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:57 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655.59797aaa-f32c-474f-9082-e992e17104f9" returned: 0 in 0.402s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created reservations ['6b4256b8-0a90-4740-bf94-20461c1c164a', '527e3d11-29c8-47db-a92d-f26932d17b83', '7aacf5f8-4e0b-4876-b0cb-dc8402ef420d', 'dd538f52-a0d6-4f26-8511-a74fce6172c4'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (6dc4e43f-04bf-4286-8188-3d6a80156995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32ddf5c-c702-4217-8391-2760e09ec088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-59797aaa-f32c-474f-9082-e992e17104f9" released by "_delete_snapshot" :: held 2.303s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-9285ee74-543b-485d-a74b-d510ef0da655" released by "delete_snapshot" :: held 2.338s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32ddf5c-c702-4217-8391-2760e09ec088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324961129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badbae6a-be8d-42ad-9a4e-6b773118577a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:58Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ccdb8d-6ff5-4439-a148-4fc106804efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ccdb8d-6ff5-4439-a148-4fc106804efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312a2e65-e609-4882-b223-89f78b8cc302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312a2e65-e609-4882-b223-89f78b8cc302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'badbae6a-be8d-42ad-9a4e-6b773118577a', 'volume_name': 'volume-badbae6a-be8d-42ad-9a4e-6b773118577a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80dd56b7-cad0-435c-ac13-d91baf0e32cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80dd56b7-cad0-435c-ac13-d91baf0e32cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fea335c-3428-44a3-b1a9-8f9b14a1d82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:57 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume badbae6a-be8d-42ad-9a4e-6b773118577a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-badbae6a-be8d-42ad-9a4e-6b773118577a', 'volume_size': 1} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Created reservations ['45706e70-5f89-4175-b633-84a3153773f1', '264cb88e-220d-465c-8849-07dd7d3e8885', '1151ec3c-620d-4fd7-b7d8-faa07358a1b2', '9590dc6f-237e-446b-a543-1649e700dc7e'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:05:57 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:05:57 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:57 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a 1073741824" returned: 0 in 0.792s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Delete snapshot completed successfully. Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-aed7c2c0-a69e-4ba4-b580-e9f67dc9d7a8 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-59797aaa-f32c-474f-9082-e992e17104f9-delete_snapshot" released by "delete_snapshot" :: held 2.665s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:58 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a Sep 09 18:05:58 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:58 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Deleted volume successfully. Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-769b2291-44d4-450f-9d7d-6546da61ddeb tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-537f7008-8d2d-4cbc-9eb6-23a139872fb1-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:58 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (a221e57d-8200-4ef0-8e1e-53a3e0436710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99758bd0-9e7e-4e81-9325-96774d815f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324961129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=badbae6a-be8d-42ad-9a4e-6b773118577a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:58Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Creating volume badbae6a-be8d-42ad-9a4e-6b773118577a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:58 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99758bd0-9e7e-4e81-9325-96774d815f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105785318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfb513c-341f-454c-b04b-407784ce3b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:58Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:58 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a 1073741824 Sep 09 18:05:58 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f387eae-3211-4960-b909-efb6b44bd209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f387eae-3211-4960-b909-efb6b44bd209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ad317a-b3f7-4151-9b0d-c364f5d980b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ad317a-b3f7-4151-9b0d-c364f5d980b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfb513c-341f-454c-b04b-407784ce3b2b', 'volume_name': 'volume-7dfb513c-341f-454c-b04b-407784ce3b2b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6ddf99-671f-4078-9935-4ff275a9850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6ddf99-671f-4078-9935-4ff275a9850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064f8a57-b6f3-463f-810c-bf75b82d1189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:58 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume 7dfb513c-341f-454c-b04b-407784ce3b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfb513c-341f-454c-b04b-407784ce3b2b', 'volume_size': 1} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeafa2a8-22ec-4055-bc25-fc7bd3b776b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f3923b-0061-4f82-9000-5529b16eb79a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7513b1ab-183d-42cc-b8f3-bb23fbd4196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:58 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume volume-e1f3923b-0061-4f82-9000-5529b16eb79a (e1f3923b-0061-4f82-9000-5529b16eb79a): created successfully Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7513b1ab-183d-42cc-b8f3-bb23fbd4196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (a3e2e06a-3065-438b-ba63-1a1794b98ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a7b49680-ba36-44f5-9a81-44867f7462aa tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created volume successfully. Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-caa7d341-a39c-4414-9a50-bda012507cb4-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:58 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-caa7d341-a39c-4414-9a50-bda012507cb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-quobyte-dcfa62d2-e442-4c2b-91b8-1ec87a040485" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a 1073741824" returned: 0 in 0.578s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-dcfa62d2-e442-4c2b-91b8-1ec87a040485" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-quobyte-caa7d341-a39c-4414-9a50-bda012507cb4" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-caa7d341-a39c-4414-9a50-bda012507cb4" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Deleting offline snapshot caa7d341-a39c-4414-9a50-bda012507cb4 of volume dcfa62d2-e442-4c2b-91b8-1ec87a040485 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:05:59 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a Sep 09 18:05:59 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] snapshot_file for this snap is: volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-9285ee74-543b-485d-a74b-d510ef0da655-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57db6af-2712-4f9f-b6a4-eadd8137ea2d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-9285ee74-543b-485d-a74b-d510ef0da655-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (427cbda2-d526-4ed9-9366-837179b59b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a598d5c7-c4d7-4d72-b00f-4efcc705bccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a598d5c7-c4d7-4d72-b00f-4efcc705bccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-14117942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc457bc-f4dc-4a48-91c5-406f96bcc431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:59Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c225a481-bfa6-4e6d-8a79-b3d75bc6a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c225a481-bfa6-4e6d-8a79-b3d75bc6a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c440cb1b-8f7c-40e1-81f2-b631edf24a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c440cb1b-8f7c-40e1-81f2-b631edf24a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc457bc-f4dc-4a48-91c5-406f96bcc431', 'volume_name': 'volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9199e93-1cfa-4a82-8e1d-981012a38459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 Sep 09 18:05:59 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9199e93-1cfa-4a82-8e1d-981012a38459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c76480e-edee-4cd9-981e-c82b8ac56892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume 2cc457bc-f4dc-4a48-91c5-406f96bcc431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431', 'volume_size': 1} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a" returned: 0 in 0.298s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-105785318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfb513c-341f-454c-b04b-407784ce3b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:58Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Creating volume 7dfb513c-341f-454c-b04b-407784ce3b2b {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:05:59 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fea335c-3428-44a3-b1a9-8f9b14a1d82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-badbae6a-be8d-42ad-9a4e-6b773118577a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b 1073741824 Sep 09 18:05:59 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9beb23-038c-4cc1-b380-1dfc17b94b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-quobyte-9285ee74-543b-485d-a74b-d510ef0da655" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-9285ee74-543b-485d-a74b-d510ef0da655" acquired by "delete_volume" :: waited 0.033s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:05:59 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume volume-badbae6a-be8d-42ad-9a4e-6b773118577a (badbae6a-be8d-42ad-9a4e-6b773118577a): created successfully Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9beb23-038c-4cc1-b380-1dfc17b94b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (6dc4e43f-04bf-4286-8188-3d6a80156995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bd4a11-f4d3-46be-bdec-2def322f9665]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-32e8f095-36ab-429f-afe0-63b0f1728574 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created volume successfully. Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (7765fa4c-bf13-41b4-8455-2f5b9c4011cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b1235d-7805-4e21-8a16-5b410601f944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b1235d-7805-4e21-8a16-5b410601f944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645391644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf81548-d180-42c5-baf1-38896bbbd072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:59Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51069a6d-ad95-4c9e-9598-153e8cbf23e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51069a6d-ad95-4c9e-9598-153e8cbf23e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc29deea-2734-4e56-9b29-e4edcde11ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 Sep 09 18:05:59 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc29deea-2734-4e56-9b29-e4edcde11ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf81548-d180-42c5-baf1-38896bbbd072', 'volume_name': 'volume-dbf81548-d180-42c5-baf1-38896bbbd072', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8f7113-2e93-47ac-895e-4041ff621156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a8f7113-2e93-47ac-895e-4041ff621156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c94ab2b-42cd-4f97-a5fc-db826b527633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:05:59 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume dbf81548-d180-42c5-baf1-38896bbbd072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf81548-d180-42c5-baf1-38896bbbd072', 'volume_size': 1} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4" returned: 0 in 0.508s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[821b7773-c9ae-4b59-b388-f5b20122dafe]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:59 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 Sep 09 18:05:59 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:59 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b 1073741824" returned: 0 in 0.545s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:59 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655" returned: 0 in 0.429s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:59 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655 Sep 09 18:05:59 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:00 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b Sep 09 18:06:00 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:00 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485" returned: 0 in 0.468s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:00 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 Sep 09 18:06:00 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:00 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-9285ee74-543b-485d-a74b-d510ef0da655" returned: 0 in 0.372s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-9285ee74-543b-485d-a74b-d510ef0da655" released by "delete_volume" :: held 0.892s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:00 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b" returned: 0 in 0.414s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.064s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-14117942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc457bc-f4dc-4a48-91c5-406f96bcc431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:59Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Creating volume 2cc457bc-f4dc-4a48-91c5-406f96bcc431 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:00 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:00 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 1073741824 Sep 09 18:06:00 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064f8a57-b6f3-463f-810c-bf75b82d1189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfb513c-341f-454c-b04b-407784ce3b2b', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043139b0-09bd-466e-ade5-343d4efc59fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Created reservations ['ddd4d36e-db84-49b2-9bc0-59766845b285', 'e94fa866-3a45-448c-951a-c8da86a7d58b', 'b4aa0fea-0637-43ec-9b71-716d77e6fb1f', '2a61c629-ae70-4775-89d6-70692b271bfc'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume volume-7dfb513c-341f-454c-b04b-407784ce3b2b (7dfb513c-341f-454c-b04b-407784ce3b2b): created successfully Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043139b0-09bd-466e-ade5-343d4efc59fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (a221e57d-8200-4ef0-8e1e-53a3e0436710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7117b4bb-e739-4d90-9e00-128378b05dc0 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created volume successfully. Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:00 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:00 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:00 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4" returned: 0 in 0.531s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:00 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4 Sep 09 18:06:00 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:00 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:00 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 1073741824" returned: 0 in 0.528s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:00 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Deleted volume successfully. Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c4714f9c-05c9-4213-b67e-fe4561aaf836 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-9285ee74-543b-485d-a74b-d510ef0da655-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:01 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485.caa7d341-a39c-4414-9a50-bda012507cb4" returned: 0 in 0.327s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:01 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 Sep 09 18:06:01 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-caa7d341-a39c-4414-9a50-bda012507cb4" released by "_delete_snapshot" :: held 2.012s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-dcfa62d2-e442-4c2b-91b8-1ec87a040485" released by "delete_snapshot" :: held 2.080s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created reservations ['13b19f82-4cf7-4ab9-aff0-f1c09aaa9825', 'c73e4a7f-3d42-4627-bd61-b5d1473d6c9b', 'd3dc0e9a-ce92-4f2d-ab73-8ec50a1786d9', '7db70e97-b92e-4e9a-a9aa-a587da113f00'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Delete snapshot completed successfully. Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ccedf19a-1185-424b-b74c-7e6ae24e7a8d tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-caa7d341-a39c-4414-9a50-bda012507cb4-delete_snapshot" released by "delete_snapshot" :: held 2.276s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:01 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431" returned: 0 in 0.345s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1645391644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf81548-d180-42c5-baf1-38896bbbd072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c56705dc85e427cb6581dffea0dddd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:05:59Z,use_quota=True,user_id='ca3c98322966400bbf1e39c758b48904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Creating volume dbf81548-d180-42c5-baf1-38896bbbd072 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:01 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-3198218e-3046-4623-ab4e-a088852f26b6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:01 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 1073741824 Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c76480e-edee-4cd9-981e-c82b8ac56892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:01 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e41a8e-faf6-4965-82bf-726ca7d92277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-3198218e-3046-4623-ab4e-a088852f26b6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:01 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 (2cc457bc-f4dc-4a48-91c5-406f96bcc431): created successfully Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e41a8e-faf6-4965-82bf-726ca7d92277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (427cbda2-d526-4ed9-9366-837179b59b5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:01 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7d1043b8-5e85-4425-b445-96a995b26bec tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created volume successfully. Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "cinder-quobyte-3198218e-3046-4623-ab4e-a088852f26b6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-3198218e-3046-4623-ab4e-a088852f26b6" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0700b805-69c8-46e7-8adf-0086e1a72488]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:01 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 Sep 09 18:06:01 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 1073741824" returned: 0 in 0.540s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:01 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:02 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 Sep 09 18:06:02 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:02 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6" returned: 0 in 0.495s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:02 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6 Sep 09 18:06:02 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-dcfa62d2-e442-4c2b-91b8-1ec87a040485-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-dcfa62d2-e442-4c2b-91b8-1ec87a040485-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "cinder-quobyte-dcfa62d2-e442-4c2b-91b8-1ec87a040485" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:02 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072" returned: 0 in 0.328s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-dcfa62d2-e442-4c2b-91b8-1ec87a040485" acquired by "delete_volume" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c94ab2b-42cd-4f97-a5fc-db826b527633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf81548-d180-42c5-baf1-38896bbbd072', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f48913f-8813-4d24-b3e1-792d4f5fcd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ffda65-a9d8-4674-afc7-3c504b87f052]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:02 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Volume volume-dbf81548-d180-42c5-baf1-38896bbbd072 (dbf81548-d180-42c5-baf1-38896bbbd072): created successfully Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f48913f-8813-4d24-b3e1-792d4f5fcd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Flow 'volume_create_manager' (7765fa4c-bf13-41b4-8455-2f5b9c4011cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-25ad7f08-c0fa-4723-b0a1-2dc905dd60cf tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created volume successfully. Sep 09 18:06:02 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-3198218e-3046-4623-ab4e-a088852f26b6" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-quobyte-3198218e-3046-4623-ab4e-a088852f26b6" released by "delete_volume" :: held 0.928s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:02 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 Sep 09 18:06:02 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Created reservations ['c82fab28-8500-43d0-a6ba-5848ba8d3dc5', '321cbac2-865e-48e2-8883-c65c720a689f', '2d44930f-8681-47a2-9486-34510104a14a', '60633b8b-9cd4-4254-9d37-f8e2fbc68675'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:02 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:02 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-dbf81548-d180-42c5-baf1-38896bbbd072-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-dbf81548-d180-42c5-baf1-38896bbbd072-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-quobyte-dbf81548-d180-42c5-baf1-38896bbbd072" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-dbf81548-d180-42c5-baf1-38896bbbd072" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:02 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485" returned: 0 in 0.502s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f87a81-9a31-4e8f-8ff0-96cee8423680]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:02 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485 Sep 09 18:06:02 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:03 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.369s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:03 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 Sep 09 18:06:03 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:03 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Deleted volume successfully. Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2f2029a-da24-4325-8494-2c651851b838 tempest-VolumeDependencyTests-764176673 None] Lock "cinder-3198218e-3046-4623-ab4e-a088852f26b6-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:03 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dcfa62d2-e442-4c2b-91b8-1ec87a040485" returned: 0 in 0.317s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-quobyte-dcfa62d2-e442-4c2b-91b8-1ec87a040485" released by "delete_volume" :: held 0.896s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Created reservations ['58177b86-1d9f-4ce3-90eb-3474d68ecabe', '7bb4f811-6291-46a5-8ff4-a63e0c4de05b', '9477882e-34ba-45aa-bd14-eb4ce81881fa', '25d293e7-6702-44e9-a912-a92bcf51aad0'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:03 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:03 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:03 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072" returned: 0 in 0.490s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:03 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072 Sep 09 18:06:03 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:03 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:03 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Deleted volume successfully. Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-34172140-ae51-4a90-bff9-4769d643b109 tempest-CreateVolumesFromSnapshotTest-1017630539 None] Lock "cinder-dcfa62d2-e442-4c2b-91b8-1ec87a040485-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:03 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-dbf81548-d180-42c5-baf1-38896bbbd072" returned: 0 in 0.365s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-dbf81548-d180-42c5-baf1-38896bbbd072" released by "delete_volume" :: held 0.924s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created reservations ['eadaadad-9135-48e2-8a2e-e6485db1f316', '20d116a5-e01f-4bbb-81dc-3d184f8ecbb1', '12dd58ad-df38-4b59-bcdb-9f38919a2bb9', '899edb0e-ebff-403a-90f4-89f8564bf8e0'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:04 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:04 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:04 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.264s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:04 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:04 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Deleted volume successfully. Sep 09 18:06:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d8ef573e-aca1-4a0e-8ec6-661c73203bdc tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-dbf81548-d180-42c5-baf1-38896bbbd072-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:05 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:05 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:05 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-2cc457bc-f4dc-4a48-91c5-406f96bcc431-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-2cc457bc-f4dc-4a48-91c5-406f96bcc431-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-quobyte-2cc457bc-f4dc-4a48-91c5-406f96bcc431" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-2cc457bc-f4dc-4a48-91c5-406f96bcc431" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc84064-3fcb-4e61-84e2-3ebaeba2960b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:05 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 Sep 09 18:06:05 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:06 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431" returned: 0 in 0.479s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:06 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431 Sep 09 18:06:06 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:06 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2cc457bc-f4dc-4a48-91c5-406f96bcc431" returned: 0 in 0.325s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-2cc457bc-f4dc-4a48-91c5-406f96bcc431" released by "delete_volume" :: held 0.860s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created reservations ['720b53cc-71a5-42e5-98b7-f2d6ef163c83', '5841578c-f784-4e44-a3c2-9b61270e322f', '03fbe3a4-25c7-4a4b-9966-092163edbd38', '1391d66c-48df-41ff-a6db-907ef04093dd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:06 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:06 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-7dfb513c-341f-454c-b04b-407784ce3b2b-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-7dfb513c-341f-454c-b04b-407784ce3b2b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-quobyte-7dfb513c-341f-454c-b04b-407784ce3b2b" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-7dfb513c-341f-454c-b04b-407784ce3b2b" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a81d98b-e242-431b-80c8-22d3b7e873af]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:07 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.372s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:07 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Deleted volume successfully. Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5e7c68e5-acec-4714-b00f-eda8c485d9e3 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-2cc457bc-f4dc-4a48-91c5-406f96bcc431-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:07 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b Sep 09 18:06:07 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:07 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b" returned: 0 in 0.464s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:07 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b Sep 09 18:06:07 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:07 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-7dfb513c-341f-454c-b04b-407784ce3b2b" returned: 0 in 0.398s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:07 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-7dfb513c-341f-454c-b04b-407784ce3b2b" released by "delete_volume" :: held 0.930s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created reservations ['091fc0a7-b06f-4f04-9185-1770f8428a92', 'd2b0b437-2ca3-459f-8c0f-9cbee78b0e2a', '7ca8e415-8787-4f67-a1de-49d681820d78', '64ec2f69-1e0e-49cd-8295-db7f5310caef'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Flow 'volume_create_manager' (586ac384-be89-44f2-bcf0-cb28dd6e186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ad081d-67e9-4f78-8f34-1966b25df362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ad081d-67e9-4f78-8f34-1966b25df362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e6b973-e777-4e82-ac6f-9526f02d3f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1690f890eb4dd3a2fc28455bf9e1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:08Z,use_quota=True,user_id='301265494c864edb9dab9411d2b476d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5b599a-6c5c-44ca-b30f-c48c2f8d5187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5b599a-6c5c-44ca-b30f-c48c2f8d5187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82564910-a46c-47b8-a8fd-8cb81f88ad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82564910-a46c-47b8-a8fd-8cb81f88ad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e6b973-e777-4e82-ac6f-9526f02d3f04', 'volume_name': 'volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d17e85b-25bb-4376-a2e9-4caf6508b6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d17e85b-25bb-4376-a2e9-4caf6508b6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7276a3-7daa-4020-b83f-cc1636a97231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:08 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Volume b6e6b973-e777-4e82-ac6f-9526f02d3f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04', 'volume_size': 1} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e6b973-e777-4e82-ac6f-9526f02d3f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1690f890eb4dd3a2fc28455bf9e1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:08Z,use_quota=True,user_id='301265494c864edb9dab9411d2b476d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Creating volume b6e6b973-e777-4e82-ac6f-9526f02d3f04 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:08 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:08 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 1073741824 Sep 09 18:06:08 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:08 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:08 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:08 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.277s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:08 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Deleted volume successfully. Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bcee314b-a7ac-4f6e-a21e-5a64d2ec15da tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-7dfb513c-341f-454c-b04b-407784ce3b2b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:08 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 1073741824" returned: 0 in 0.552s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:08 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 Sep 09 18:06:08 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:09 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04" returned: 0 in 0.299s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7276a3-7daa-4020-b83f-cc1636a97231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8ea843-203e-49e0-af28-b6e90c2ec174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:09 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Volume volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 (b6e6b973-e777-4e82-ac6f-9526f02d3f04): created successfully Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8ea843-203e-49e0-af28-b6e90c2ec174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Flow 'volume_create_manager' (586ac384-be89-44f2-bcf0-cb28dd6e186c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:09 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-04a220f1-f823-4c24-807c-28566006f82b tempest-CinderUnicodeTest-143527449 None] Created volume successfully. Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-badbae6a-be8d-42ad-9a4e-6b773118577a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-badbae6a-be8d-42ad-9a4e-6b773118577a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-quobyte-badbae6a-be8d-42ad-9a4e-6b773118577a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-badbae6a-be8d-42ad-9a4e-6b773118577a" acquired by "delete_volume" :: waited 0.030s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb25fba3-d0a2-4d22-9bee-784d14737149]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:09 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a Sep 09 18:06:09 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:09 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a" returned: 0 in 0.436s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:09 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a Sep 09 18:06:09 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:10 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-badbae6a-be8d-42ad-9a4e-6b773118577a" returned: 0 in 0.327s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-badbae6a-be8d-42ad-9a4e-6b773118577a" released by "delete_volume" :: held 0.822s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created reservations ['7f03737b-6731-4781-8394-0c4eac435c33', '5e6215af-e3da-42d7-859b-13d10cac3b4a', 'ab513c6c-c9ed-43d3-a603-a9588f51f089', '90f7e370-226d-4003-a59a-8a68b8639a38'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:10 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:10 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-e1f3923b-0061-4f82-9000-5529b16eb79a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-e1f3923b-0061-4f82-9000-5529b16eb79a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-quobyte-e1f3923b-0061-4f82-9000-5529b16eb79a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-e1f3923b-0061-4f82-9000-5529b16eb79a" acquired by "delete_volume" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73dec29-66e4-4f43-856d-4c9315547924]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:10 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a Sep 09 18:06:10 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:10 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.569s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:10 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Deleted volume successfully. Sep 09 18:06:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-de6fa80a-93c6-456c-a98d-aee6a07f0a12 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-badbae6a-be8d-42ad-9a4e-6b773118577a-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Flow 'volume_create_manager' (d110fdb3-e0c6-4f22-816d-359e27b14319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16888666-1ac0-4ad6-8eeb-15a608d7261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16888666-1ac0-4ad6-8eeb-15a608d7261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1075506482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83d7449-a543-4229-9adb-64f9ba9a37ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1690f890eb4dd3a2fc28455bf9e1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:11Z,use_quota=True,user_id='301265494c864edb9dab9411d2b476d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece2c2ff-2c28-4255-a1e6-49d18b0d1fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:11 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece2c2ff-2c28-4255-a1e6-49d18b0d1fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70478193-3e78-4bd8-9bec-4e267c3a07d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70478193-3e78-4bd8-9bec-4e267c3a07d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83d7449-a543-4229-9adb-64f9ba9a37ac', 'volume_name': 'volume-e83d7449-a543-4229-9adb-64f9ba9a37ac', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9141a817-6587-4c52-82fc-d5a0b861b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9141a817-6587-4c52-82fc-d5a0b861b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc487ea1-85f1-45a3-8729-0ffde54c4ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:11 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Volume e83d7449-a543-4229-9adb-64f9ba9a37ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83d7449-a543-4229-9adb-64f9ba9a37ac', 'volume_size': 1} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1075506482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83d7449-a543-4229-9adb-64f9ba9a37ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1690f890eb4dd3a2fc28455bf9e1bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:11Z,use_quota=True,user_id='301265494c864edb9dab9411d2b476d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Creating volume e83d7449-a543-4229-9adb-64f9ba9a37ac {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:11 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a" returned: 0 in 0.588s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:11 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac 1073741824 Sep 09 18:06:11 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:11 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a Sep 09 18:06:11 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:11 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e1f3923b-0061-4f82-9000-5529b16eb79a" returned: 0 in 0.297s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-e1f3923b-0061-4f82-9000-5529b16eb79a" released by "delete_volume" :: held 0.937s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created reservations ['06cfdcc4-bb03-44c9-a0f4-041ca0207dc7', 'bd1cf52a-9a23-434c-aa0f-07f0b95555d6', '6d1046bc-6353-424e-bf49-1f3c4a06d8e1', '8562c7fd-ce15-442b-b6ba-8c130723503a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:11 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:11 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:11 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac 1073741824" returned: 0 in 0.748s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "cinder-quobyte-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[22859d1f-dd75-4bda-bf0a-39f08cfb6d2a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:12 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.371s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Deleted volume successfully. Sep 09 18:06:12 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac Sep 09 18:06:12 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-77d0203d-d534-4d98-9351-62a96b40f0ed tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-e1f3923b-0061-4f82-9000-5529b16eb79a-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:12 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac Sep 09 18:06:12 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:12 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac" returned: 0 in 0.355s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc487ea1-85f1-45a3-8729-0ffde54c4ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83d7449-a543-4229-9adb-64f9ba9a37ac', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a10fe85-a95a-4ca7-8c83-f2a0473aa789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:12 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Volume volume-e83d7449-a543-4229-9adb-64f9ba9a37ac (e83d7449-a543-4229-9adb-64f9ba9a37ac): created successfully Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a10fe85-a95a-4ca7-8c83-f2a0473aa789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Flow 'volume_create_manager' (d110fdb3-e0c6-4f22-816d-359e27b14319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d37880a9-7138-44dc-b476-b4b30661c930 tempest-CinderUnicodeTest-143527449 None] Created volume successfully. Sep 09 18:06:12 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac" returned: 0 in 0.518s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:12 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac Sep 09 18:06:12 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:12 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac" returned: 0 in 0.322s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-quobyte-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac" released by "delete_volume" :: held 0.920s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:12 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Created reservations ['8db8bafd-64cf-4588-b76a-f911d51b49cd', '72e11207-a424-4c8b-a78d-149ebb98df50', '8cc39c5d-563d-487e-83d5-24d195ec4c5d', '05822709-7d7b-47e1-8504-4e2897339836'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:13 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:13 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:13 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.323s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Deleted volume successfully. Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-836ec549-ae23-4ff7-89b3-5b6eae1af6a7 tempest-CreateVolumesFromSourceVolumeTest-1722965931 None] Lock "cinder-0fecd58b-5a20-4bdf-8c01-7e2bd4aa81ac-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Creating offline snapshot c6c43b29-cc0a-473e-8cb8-2799c0675ae5 of volume e83d7449-a543-4229-9adb-64f9ba9a37ac {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ced83c-76d7-4953-ab1a-b1e7efe948e7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:13 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac Sep 09 18:06:13 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:13 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac" returned: 0 in 0.407s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:14 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 1G Sep 09 18:06:14 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:14 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 1G" returned: 0 in 0.662s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83d7449-a543-4229-9adb-64f9ba9a37ac -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:14 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83d7449-a543-4229-9adb-64f9ba9a37ac -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 Sep 09 18:06:14 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:15 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83d7449-a543-4229-9adb-64f9ba9a37ac -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5" returned: 0 in 0.490s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:15 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 is being set with open permissions: ugo+rw Sep 09 18:06:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:15 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 Sep 09 18:06:15 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:15 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5" returned: 0 in 0.333s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:15 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.info Sep 09 18:06:15 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:15 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.info" returned: 0 in 0.306s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:15 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.info is being set with open permissions: ugo+rw Sep 09 18:06:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:15 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.info Sep 09 18:06:15 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:16 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.info" returned: 0 in 0.287s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.610s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:16 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-3309471e-7181-4847-a4c6-5abc64e9e612 tempest-CinderUnicodeTest-143527449 None] Create snapshot completed successfully Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "cinder-c6c43b29-cc0a-473e-8cb8-2799c0675ae5-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-c6c43b29-cc0a-473e-8cb8-2799c0675ae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "cinder-quobyte-e83d7449-a543-4229-9adb-64f9ba9a37ac" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-quobyte-e83d7449-a543-4229-9adb-64f9ba9a37ac" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "cinder-quobyte-c6c43b29-cc0a-473e-8cb8-2799c0675ae5" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-quobyte-c6c43b29-cc0a-473e-8cb8-2799c0675ae5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Deleting offline snapshot c6c43b29-cc0a-473e-8cb8-2799c0675ae5 of volume e83d7449-a543-4229-9adb-64f9ba9a37ac {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] snapshot_file for this snap is: volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caed028-611a-41a3-a222-f9ddc2e4c10c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:17 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 Sep 09 18:06:17 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:17 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5" returned: 0 in 0.601s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e83d7449-a543-4229-9adb-64f9ba9a37ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:06:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd056cee-5c32-4b38-afcc-ce2907819240]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:17 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac Sep 09 18:06:17 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:17 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac" returned: 0 in 0.457s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:18 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 Sep 09 18:06:18 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:18 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5" returned: 0 in 0.404s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:18 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5 Sep 09 18:06:18 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:18 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac.c6c43b29-cc0a-473e-8cb8-2799c0675ae5" returned: 0 in 0.291s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-quobyte-c6c43b29-cc0a-473e-8cb8-2799c0675ae5" released by "_delete_snapshot" :: held 1.926s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-quobyte-e83d7449-a543-4229-9adb-64f9ba9a37ac" released by "delete_snapshot" :: held 1.964s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:18 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Created reservations ['431f2ba3-63e2-423d-a8b9-2cfdd7d2b30e', '1bbfa7db-e20a-4a2b-b538-65ed44000049', '48e3c9be-9660-4e31-8ef9-97a2e7f14c0a', 'b7978a52-83ac-4263-897b-b06f148ed79a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:18 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Delete snapshot completed successfully. Sep 09 18:06:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9567333c-7529-4197-96b0-f31e8523bd27 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-c6c43b29-cc0a-473e-8cb8-2799c0675ae5-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Acquiring lock "cinder-e83d7449-a543-4229-9adb-64f9ba9a37ac-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Lock "cinder-e83d7449-a543-4229-9adb-64f9ba9a37ac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Acquiring lock "cinder-quobyte-e83d7449-a543-4229-9adb-64f9ba9a37ac" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Lock "cinder-quobyte-e83d7449-a543-4229-9adb-64f9ba9a37ac" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:19 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[53282e78-7d69-4145-9b69-c7790e970856]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:19 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac Sep 09 18:06:19 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:19 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac" returned: 0 in 0.571s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:19 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac Sep 09 18:06:19 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:20 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e83d7449-a543-4229-9adb-64f9ba9a37ac" returned: 0 in 0.305s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Lock "cinder-quobyte-e83d7449-a543-4229-9adb-64f9ba9a37ac" released by "delete_volume" :: held 0.994s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Created reservations ['a537c5f5-8462-40f4-857c-0123af09e366', '573f795c-9795-4df0-bab4-8fda4ac575fc', '80aa0841-f29e-4652-ac53-2711a4c46067', '86df00ec-4548-4f2f-8644-535db099f8ac'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:20 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:20 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:20 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.300s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:20 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Deleted volume successfully. Sep 09 18:06:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e2c82f4b-0e11-42c3-912a-dc8c3599743f tempest-CinderUnicodeTest-143527449 None] Lock "cinder-e83d7449-a543-4229-9adb-64f9ba9a37ac-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "cinder-b6e6b973-e777-4e82-ac6f-9526f02d3f04-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Flow 'volume_create_manager' (060b4429-2974-4cb6-8e47-a5cbff9cf53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4208c9-1f4d-44d3-85a1-3c6b0c9c91e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-b6e6b973-e777-4e82-ac6f-9526f02d3f04-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4208c9-1f4d-44d3-85a1-3c6b0c9c91e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885ccd6f-df10-40c0-9f49-eab30301fbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809b3e8ed7e34f35b4513158766d719a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:21Z,use_quota=True,user_id='5dc585a45e6c499e89520eacbff9273d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e620a6-af3c-4b0b-b624-1d4bee2700e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e620a6-af3c-4b0b-b624-1d4bee2700e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a7df74-07da-4158-a8c6-0eb578006359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.image.glance [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Creating Keystone auth plugin from conf {{(pid=87202) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "cinder-quobyte-b6e6b973-e777-4e82-ac6f-9526f02d3f04" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-quobyte-b6e6b973-e777-4e82-ac6f-9526f02d3f04" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6476c731-d888-444f-aa38-65a9514da430]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:21 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 Sep 09 18:06:21 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a7df74-07da-4158-a8c6-0eb578006359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '885ccd6f-df10-40c0-9f49-eab30301fbcc', 'volume_name': 'volume-885ccd6f-df10-40c0-9f49-eab30301fbcc', 'volume_size': 1, 'image_id': 'bb44de47-491f-4399-8250-be49f4a15172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb44de47-491f-4399-8250-be49f4a15172', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51da45ad685fd1d248ac329e9f9c79ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809b3e8ed7e34f35b4513158766d719a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '819de388bb7ff1f1fddd49bfd59babd8e6d6b168f303124af8435e883353fb818a48a66cce4e83f6d3b3ec6a61954716c40f794e52df1b613d84ca674b72e712', 'id': 'bb44de47-491f-4399-8250-be49f4a15172', 'created_at': datetime.datetime(2026, 9, 9, 16, 6, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 6, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb44de47-491f-4399-8250-be49f4a15172/file', 'properties': {}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e03f0e-a637-4416-a1fe-8827c5e0a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e03f0e-a637-4416-a1fe-8827c5e0a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ea416b-c537-4468-a286-eb60ed74a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:21 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Volume 885ccd6f-df10-40c0-9f49-eab30301fbcc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-885ccd6f-df10-40c0-9f49-eab30301fbcc', 'volume_size': 1, 'image_id': 'bb44de47-491f-4399-8250-be49f4a15172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb44de47-491f-4399-8250-be49f4a15172', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51da45ad685fd1d248ac329e9f9c79ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809b3e8ed7e34f35b4513158766d719a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '819de388bb7ff1f1fddd49bfd59babd8e6d6b168f303124af8435e883353fb818a48a66cce4e83f6d3b3ec6a61954716c40f794e52df1b613d84ca674b72e712', 'id': 'bb44de47-491f-4399-8250-be49f4a15172', 'created_at': datetime.datetime(2026, 9, 9, 16, 6, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 6, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb44de47-491f-4399-8250-be49f4a15172/file', 'properties': {}}, 'image_service': } Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Trying to clone 885ccd6f-df10-40c0-9f49-eab30301fbcc from image bb44de47-491f-4399-8250-be49f4a15172 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb44de47-491f-4399-8250-be49f4a15172', 'metadata': {}}]). {{(pid=87202) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:06:21 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04" returned: 0 in 0.499s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:22 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04 Sep 09 18:06:22 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:06:22 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Image download 0.00 MB at 0.00 MB/s Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd53c62e-5532-4fe0-be08-84ea68e888ea]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:22 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD Sep 09 18:06:22 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:22 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-b6e6b973-e777-4e82-ac6f-9526f02d3f04" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-quobyte-b6e6b973-e777-4e82-ac6f-9526f02d3f04" released by "delete_volume" :: held 0.908s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Created reservations ['5cf505b3-5942-49c2-a16a-8ad05afb0526', '86da4bab-fc59-4f26-a26f-af76c1590064', '4bb65eff-8874-477e-984a-ef02b93d23f5', '043b26a4-c7c2-4bfa-b7d6-7c4ac7d1bf4b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:22 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:22 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:22 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:22 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD Sep 09 18:06:22 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:22 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Deleted volume successfully. Sep 09 18:06:22 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7cf9941a-4b2b-46c8-a2bb-847ca4cb6075 tempest-CinderUnicodeTest-143527449 None] Lock "cinder-b6e6b973-e777-4e82-ac6f-9526f02d3f04-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:23 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Temporary image bb44de47-491f-4399-8250-be49f4a15172 is fetched for user 5dc585a45e6c499e89520eacbff9273d. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4755c8-9fe8-4443-b770-dc90389049b4]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:23 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD Sep 09 18:06:23 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:23 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:23 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD Sep 09 18:06:23 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:23 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=885ccd6f-df10-40c0-9f49-eab30301fbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='809b3e8ed7e34f35b4513158766d719a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:21Z,use_quota=True,user_id='5dc585a45e6c499e89520eacbff9273d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Creating volume 885ccd6f-df10-40c0-9f49-eab30301fbcc {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:23 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:24 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc 1073741824 Sep 09 18:06:24 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:24 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc 1073741824" returned: 0 in 0.694s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:24 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc Sep 09 18:06:24 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:25 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc" returned: 0 in 0.443s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:25 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Attempting download of bb44de47-491f-4399-8250-be49f4a15172 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb44de47-491f-4399-8250-be49f4a15172', 'metadata': {}}])) to volume 885ccd6f-df10-40c0-9f49-eab30301fbcc. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:06:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[01570f26-2db8-46a3-9cef-abad94129366]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb44de47-491f-4399-8250-be49f4a15172_7t67l41p {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:25 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb44de47-491f-4399-8250-be49f4a15172_7t67l41p Sep 09 18:06:25 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:25 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb44de47-491f-4399-8250-be49f4a15172_7t67l41p" returned: 0 in 0.401s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb44de47-491f-4399-8250-be49f4a15172_7t67l41p {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:25 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb44de47-491f-4399-8250-be49f4a15172_7t67l41p Sep 09 18:06:25 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:26 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb44de47-491f-4399-8250-be49f4a15172_7t67l41p" returned: 1 in 0.395s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb44de47-491f-4399-8250-be49f4a15172_7t67l41p' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[151c75bc-a284-4eb5-870b-7f24515604db]: (4, 'raw') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:26 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD Sep 09 18:06:26 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:26 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:26 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD Sep 09 18:06:26 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:26 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] bb44de47-491f-4399-8250-be49f4a15172 was raw, converting to qcow2 {{(pid=87202) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:06:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:26 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc Sep 09 18:06:26 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:27 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc" returned: 0 in 0.560s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb44de47-491f-4399-8250-be49f4a15172_3f0tanakdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:06:27 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:27 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc 1G Sep 09 18:06:27 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Flow 'volume_create_manager' (274af4b8-f03f-4926-811a-b0beb4a1fba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf7cd16-42da-4743-b798-1c3c5ad2cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf7cd16-42da-4743-b798-1c3c5ad2cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959511468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba1cd7d-c431-4c43-a346-a9fec9885d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1e568836a748f7a3cf67bdc4e851b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:27Z,use_quota=True,user_id='f694c007dc1d44a79da09201ec0506e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd96722c-dc7f-460a-993c-6b3b81466e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd96722c-dc7f-460a-993c-6b3b81466e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626e0901-64a9-44d9-9049-ee55c205eb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626e0901-64a9-44d9-9049-ee55c205eb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba1cd7d-c431-4c43-a346-a9fec9885d6e', 'volume_name': 'volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f13624-31c5-4f1e-8065-22126a513707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f13624-31c5-4f1e-8065-22126a513707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719a1e49-4278-4735-b711-f3457746c67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:27 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Volume 5ba1cd7d-c431-4c43-a346-a9fec9885d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e', 'volume_size': 1} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959511468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba1cd7d-c431-4c43-a346-a9fec9885d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1e568836a748f7a3cf67bdc4e851b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:27Z,use_quota=True,user_id='f694c007dc1d44a79da09201ec0506e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Creating volume 5ba1cd7d-c431-4c43-a346-a9fec9885d6e {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:27 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:27 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e 1073741824 Sep 09 18:06:27 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:27 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc 1G" returned: 0 in 0.451s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Downloaded image bb44de47-491f-4399-8250-be49f4a15172 ((None, [{'url': 'file:///opt/stack/data/glance/images/bb44de47-491f-4399-8250-be49f4a15172', 'metadata': {}}])) to volume 885ccd6f-df10-40c0-9f49-eab30301fbcc successfully. {{(pid=87202) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Temporary image bb44de47-491f-4399-8250-be49f4a15172 for user 5dc585a45e6c499e89520eacbff9273d is deleted. {{(pid=87202) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.volume_utils [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Marking volume 885ccd6f-df10-40c0-9f49-eab30301fbcc as bootable. {{(pid=87202) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Copying metadata from image bb44de47-491f-4399-8250-be49f4a15172 to 885ccd6f-df10-40c0-9f49-eab30301fbcc. {{(pid=87202) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Creating volume glance metadata for volume 885ccd6f-df10-40c0-9f49-eab30301fbcc backed by image bb44de47-491f-4399-8250-be49f4a15172 with: {'image_id': 'bb44de47-491f-4399-8250-be49f4a15172', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '51da45ad685fd1d248ac329e9f9c79ec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87202) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ea416b-c537-4468-a286-eb60ed74a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-885ccd6f-df10-40c0-9f49-eab30301fbcc', 'volume_size': 1, 'image_id': 'bb44de47-491f-4399-8250-be49f4a15172', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb44de47-491f-4399-8250-be49f4a15172', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51da45ad685fd1d248ac329e9f9c79ec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '809b3e8ed7e34f35b4513158766d719a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '819de388bb7ff1f1fddd49bfd59babd8e6d6b168f303124af8435e883353fb818a48a66cce4e83f6d3b3ec6a61954716c40f794e52df1b613d84ca674b72e712', 'id': 'bb44de47-491f-4399-8250-be49f4a15172', 'created_at': datetime.datetime(2026, 9, 9, 16, 6, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 6, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb44de47-491f-4399-8250-be49f4a15172/file', 'properties': {}}, 'image_service': }' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4cff17-1e74-4b20-a4c3-a2dd786a7a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:27 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Volume volume-885ccd6f-df10-40c0-9f49-eab30301fbcc (885ccd6f-df10-40c0-9f49-eab30301fbcc): created successfully Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4cff17-1e74-4b20-a4c3-a2dd786a7a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:27 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Flow 'volume_create_manager' (060b4429-2974-4cb6-8e47-a5cbff9cf53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:28 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-66c3b4a8-4ba4-40b1-96a9-59932d8e9304 tempest-VolumeImageDependencyTests-1616271837 None] Created volume successfully. Sep 09 18:06:28 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e 1073741824" returned: 0 in 0.647s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:28 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e Sep 09 18:06:28 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-81cfd50d-0661-48cc-b17f-d7c271a32a21 tempest-ProjectAdminTests-1745059773 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3011779785156, 'free_capacity_gb': 1773.3011779785156, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87202) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 18:06:28 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e" returned: 0 in 0.329s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719a1e49-4278-4735-b711-f3457746c67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4230a23-e7bc-4e0b-8f4c-8911b88745f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:28 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Volume volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e (5ba1cd7d-c431-4c43-a346-a9fec9885d6e): created successfully Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4230a23-e7bc-4e0b-8f4c-8911b88745f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Flow 'volume_create_manager' (274af4b8-f03f-4926-811a-b0beb4a1fba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:28 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-cee2811d-716e-4a5c-8e0f-01c5e01c47a2 tempest-ProjectReaderTests-1169667351 None] Created volume successfully. Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Acquiring lock "cinder-885ccd6f-df10-40c0-9f49-eab30301fbcc-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Lock "cinder-885ccd6f-df10-40c0-9f49-eab30301fbcc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=207,cinder:UPDATE=270,cinder:INSERT=71,cinder:DELETE=24 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Acquiring lock "cinder-quobyte-885ccd6f-df10-40c0-9f49-eab30301fbcc" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Lock "cinder-quobyte-885ccd6f-df10-40c0-9f49-eab30301fbcc" acquired by "delete_volume" :: waited 0.041s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2ee6d6-d382-4921-a515-713d35c261b0]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:29 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc Sep 09 18:06:29 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:29 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc" returned: 0 in 0.504s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:29 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc Sep 09 18:06:29 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "cinder-5ba1cd7d-c431-4c43-a346-a9fec9885d6e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Lock "cinder-5ba1cd7d-c431-4c43-a346-a9fec9885d6e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:29 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=192,cinder:UPDATE=277,cinder:INSERT=75,cinder:DELETE=25 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "cinder-quobyte-5ba1cd7d-c431-4c43-a346-a9fec9885d6e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Lock "cinder-quobyte-5ba1cd7d-c431-4c43-a346-a9fec9885d6e" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0548db4b-becd-4674-96e0-9b914e0e05b5]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:30 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-885ccd6f-df10-40c0-9f49-eab30301fbcc" returned: 0 in 0.373s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Lock "cinder-quobyte-885ccd6f-df10-40c0-9f49-eab30301fbcc" released by "delete_volume" :: held 0.939s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Created reservations ['6088cf7c-2298-4f36-904a-4d46680382b1', '183a98ba-7d89-4bb7-90fc-87bc5e7bd640', 'c2d3fcee-fbe6-4685-808b-e4705d2095fd', '6372d004-ca62-4e38-ab80-660d7cd80921'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:30 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e Sep 09 18:06:30 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:30 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:30 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:30 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e" returned: 0 in 0.446s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:30 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e Sep 09 18:06:30 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:30 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.321s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:30 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Deleted volume successfully. Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-782e1506-0d4f-4be7-8300-726d2f6c65e0 tempest-VolumeImageDependencyTests-1616271837 None] Lock "cinder-885ccd6f-df10-40c0-9f49-eab30301fbcc-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:30 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-5ba1cd7d-c431-4c43-a346-a9fec9885d6e" returned: 0 in 0.325s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Lock "cinder-quobyte-5ba1cd7d-c431-4c43-a346-a9fec9885d6e" released by "delete_volume" :: held 0.834s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:30 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Created reservations ['955f4d93-1e32-4966-b32c-f3211076cab6', '1b6a7fb6-ea0b-4c1e-8e99-506f6db9ab72', 'f907615f-bf46-4c0b-a7fa-dc840d1161dc', 'ecfc210d-055f-4955-ad76-a5dd1589114a'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:31 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:31 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:31 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.405s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:31 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Deleted volume successfully. Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d23f291c-f472-4e0a-a0d7-0d480a3609e8 tempest-ProjectReaderTests-1169667351 None] Lock "cinder-5ba1cd7d-c431-4c43-a346-a9fec9885d6e-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Flow 'volume_create_manager' (6ac60dc9-257b-413d-add9-9a0b9814a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7489a342-5f7d-4a5a-a5a5-8af27883a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7489a342-5f7d-4a5a-a5a5-8af27883a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-654213185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c905488c-01e4-4df6-b000-40363b06f46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1e568836a748f7a3cf67bdc4e851b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:32Z,use_quota=True,user_id='f694c007dc1d44a79da09201ec0506e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4926536-b2e4-4185-a392-70f3e53fd8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4926536-b2e4-4185-a392-70f3e53fd8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34b9882-6588-4a56-9dd0-c9a94aff8138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34b9882-6588-4a56-9dd0-c9a94aff8138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c905488c-01e4-4df6-b000-40363b06f46a', 'volume_name': 'volume-c905488c-01e4-4df6-b000-40363b06f46a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e55b967-fa7d-4d19-9738-b002606b35cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e55b967-fa7d-4d19-9738-b002606b35cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119e6f8a-d7e5-424e-8886-809f83bc8385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:31 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Volume c905488c-01e4-4df6-b000-40363b06f46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c905488c-01e4-4df6-b000-40363b06f46a', 'volume_size': 1} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-654213185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c905488c-01e4-4df6-b000-40363b06f46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1e568836a748f7a3cf67bdc4e851b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:32Z,use_quota=True,user_id='f694c007dc1d44a79da09201ec0506e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Creating volume c905488c-01e4-4df6-b000-40363b06f46a {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:31 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:31 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a 1073741824 Sep 09 18:06:31 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:32 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a 1073741824" returned: 0 in 0.580s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:32 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a Sep 09 18:06:32 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:32 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a" returned: 0 in 0.456s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119e6f8a-d7e5-424e-8886-809f83bc8385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c905488c-01e4-4df6-b000-40363b06f46a', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86ece23-ac4e-41bd-8db6-4b85a1ef5380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Volume volume-c905488c-01e4-4df6-b000-40363b06f46a (c905488c-01e4-4df6-b000-40363b06f46a): created successfully Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86ece23-ac4e-41bd-8db6-4b85a1ef5380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Flow 'volume_create_manager' (6ac60dc9-257b-413d-add9-9a0b9814a788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e3677fe9-9bc8-423e-8f19-7bb46ac829e4 tempest-ProjectReaderTests-1169667351 None] Created volume successfully. Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (6907dd72-9d9a-49b6-b8a3-66483fe43422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71031e0d-62e0-401d-a778-5f1f4a27c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71031e0d-62e0-401d-a778-5f1f4a27c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1208213312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de905158-bd74-4911-afa5-8fb4ffd14678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:34Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5844c57-cde7-41fd-ac81-3daca0bde77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5844c57-cde7-41fd-ac81-3daca0bde77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9b3eb1-a7e8-4d4a-86ac-21b032e69710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9b3eb1-a7e8-4d4a-86ac-21b032e69710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de905158-bd74-4911-afa5-8fb4ffd14678', 'volume_name': 'volume-de905158-bd74-4911-afa5-8fb4ffd14678', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8808854-59bb-445a-8659-88e17a6620b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8808854-59bb-445a-8659-88e17a6620b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31718b2-cd23-4a9e-80e9-1142f3d72b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:33 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Volume de905158-bd74-4911-afa5-8fb4ffd14678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de905158-bd74-4911-afa5-8fb4ffd14678', 'volume_size': 1} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1208213312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de905158-bd74-4911-afa5-8fb4ffd14678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:34Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Creating volume de905158-bd74-4911-afa5-8fb4ffd14678 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:33 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:33 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 1073741824 Sep 09 18:06:33 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "cinder-c905488c-01e4-4df6-b000-40363b06f46a-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Lock "cinder-c905488c-01e4-4df6-b000-40363b06f46a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "cinder-quobyte-c905488c-01e4-4df6-b000-40363b06f46a" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Lock "cinder-quobyte-c905488c-01e4-4df6-b000-40363b06f46a" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64b7cec-4c1f-48cc-beb2-5a98a7c11f62]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:34 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a Sep 09 18:06:34 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:34 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 1073741824" returned: 0 in 0.647s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:34 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 Sep 09 18:06:34 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:34 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a" returned: 0 in 0.648s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:34 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a Sep 09 18:06:34 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:34 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678" returned: 0 in 0.392s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31718b2-cd23-4a9e-80e9-1142f3d72b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de905158-bd74-4911-afa5-8fb4ffd14678', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d5b21e-86fe-4f01-9301-7e5e767092da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:34 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Volume volume-de905158-bd74-4911-afa5-8fb4ffd14678 (de905158-bd74-4911-afa5-8fb4ffd14678): created successfully Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d5b21e-86fe-4f01-9301-7e5e767092da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (6907dd72-9d9a-49b6-b8a3-66483fe43422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-96885dae-9804-4b4d-b134-633f17095167 tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:06:35 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c905488c-01e4-4df6-b000-40363b06f46a" returned: 0 in 0.337s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Lock "cinder-quobyte-c905488c-01e4-4df6-b000-40363b06f46a" released by "delete_volume" :: held 1.040s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Created reservations ['0a4c5b89-fde8-40e5-a191-652b35671792', '43a68175-5b95-4a7f-9d81-55a7dce30389', '23135c88-5d9f-4623-9859-0ef8aacf17ba', 'ee533d2f-d5cf-4516-97ab-4dfc0465b516'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:35 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:35 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:35 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.326s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Deleted volume successfully. Sep 09 18:06:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-75ed3b8b-b5d9-440c-933e-053d0f9d69c1 tempest-ProjectReaderTests-1169667351 None] Lock "cinder-c905488c-01e4-4df6-b000-40363b06f46a-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Creating offline snapshot 0b804e9a-ce11-44b0-b6e5-7ad6921d9243 of volume de905158-bd74-4911-afa5-8fb4ffd14678 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:06:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[42046f7e-911c-477f-abf8-2222f125c59d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:36 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 Sep 09 18:06:36 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:36 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678" returned: 0 in 0.470s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:36 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 1G Sep 09 18:06:36 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:37 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 1G" returned: 0 in 0.597s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de905158-bd74-4911-afa5-8fb4ffd14678 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:37 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de905158-bd74-4911-afa5-8fb4ffd14678 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 Sep 09 18:06:37 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:38 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de905158-bd74-4911-afa5-8fb4ffd14678 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243" returned: 0 in 0.480s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:38 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 is being set with open permissions: ugo+rw Sep 09 18:06:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:38 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 Sep 09 18:06:38 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:38 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243" returned: 0 in 0.310s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:38 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.info Sep 09 18:06:38 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:38 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.info" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:38 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.info is being set with open permissions: ugo+rw Sep 09 18:06:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:38 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.info Sep 09 18:06:38 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:39 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.info" returned: 0 in 0.372s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:39 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d8901dda-cbdc-4a9d-9499-b5851fd2d7bc tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-0b804e9a-ce11-44b0-b6e5-7ad6921d9243-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Lock "cinder-0b804e9a-ce11-44b0-b6e5-7ad6921d9243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-de905158-bd74-4911-afa5-8fb4ffd14678" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-de905158-bd74-4911-afa5-8fb4ffd14678" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-0b804e9a-ce11-44b0-b6e5-7ad6921d9243" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-0b804e9a-ce11-44b0-b6e5-7ad6921d9243" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot 0b804e9a-ce11-44b0-b6e5-7ad6921d9243 of volume de905158-bd74-4911-afa5-8fb4ffd14678 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd970d-7d42-4e1c-8c48-be72501b6c09]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:39 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 Sep 09 18:06:39 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:40 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243" returned: 0 in 0.454s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de905158-bd74-4911-afa5-8fb4ffd14678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4de56dc-9d31-4839-9890-6ca7bec0af83]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:40 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 Sep 09 18:06:40 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Flow 'volume_create_manager' (7f9cb36e-c47d-44cc-9fe5-434a40f0d78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc15ff6-52df-46b1-b2a9-15892aa38eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc15ff6-52df-46b1-b2a9-15892aa38eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-929174046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559013a3-f9c9-4c65-b7bb-e608aef5aa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8b7ff7e1324824994fc2a9331bc6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:40Z,use_quota=True,user_id='833b30eb52924890a1471595bafad645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a47f6f-323c-4c07-b574-2fd487f20a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a47f6f-323c-4c07-b574-2fd487f20a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41155f6-4f03-4a8f-b9c6-8e9ff839bcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41155f6-4f03-4a8f-b9c6-8e9ff839bcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559013a3-f9c9-4c65-b7bb-e608aef5aa7f', 'volume_name': 'volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077cbcf-b68a-4109-9be0-0966a785a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077cbcf-b68a-4109-9be0-0966a785a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54fedc5a-7d68-4f36-8c4f-c5e96eecd543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:40 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Volume 559013a3-f9c9-4c65-b7bb-e608aef5aa7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f', 'volume_size': 1} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-929174046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559013a3-f9c9-4c65-b7bb-e608aef5aa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8b7ff7e1324824994fc2a9331bc6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:40Z,use_quota=True,user_id='833b30eb52924890a1471595bafad645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Creating volume 559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:40 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:40 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f 1073741824 Sep 09 18:06:40 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:40 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678" returned: 0 in 0.480s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:40 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 Sep 09 18:06:40 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:41 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f 1073741824" returned: 0 in 0.572s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:41 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f Sep 09 18:06:41 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:41 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243" returned: 0 in 0.474s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:41 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243 Sep 09 18:06:41 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:41 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" returned: 0 in 0.391s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:41 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54fedc5a-7d68-4f36-8c4f-c5e96eecd543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb48c070-c58e-475f-b3a0-667bf862c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678.0b804e9a-ce11-44b0-b6e5-7ad6921d9243" returned: 0 in 0.382s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:41 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Volume volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f (559013a3-f9c9-4c65-b7bb-e608aef5aa7f): created successfully Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb48c070-c58e-475f-b3a0-667bf862c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Flow 'volume_create_manager' (7f9cb36e-c47d-44cc-9fe5-434a40f0d78d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-0b804e9a-ce11-44b0-b6e5-7ad6921d9243" released by "_delete_snapshot" :: held 1.960s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-2f468b72-e11a-4449-aeb7-b26fdd4ca5db tempest-SnapshotDependencyTests-245955263 None] Created volume successfully. Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-de905158-bd74-4911-afa5-8fb4ffd14678" released by "delete_snapshot" :: held 2.004s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Created reservations ['64d0a4cb-d07e-4a17-83f3-e66cbf3d7752', '377d7c32-1632-4b55-95fc-f9e749dba7fe', '9afdb6cf-93d1-44bf-8687-b11c7c332782', '64787c4e-f6f2-40a4-b4d5-bfa917b2c841'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:06:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4a849603-6c61-4980-8e7c-62f5d21a47c6 tempest-ProjectMemberTests-805547256 None] Lock "cinder-0b804e9a-ce11-44b0-b6e5-7ad6921d9243-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Creating offline snapshot 01d8b511-ead5-4cd4-86f1-5003e10d44a3 of volume 559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:06:42 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a39f0-abd3-4396-96da-747a99e4f21e]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-de905158-bd74-4911-afa5-8fb4ffd14678-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Lock "cinder-de905158-bd74-4911-afa5-8fb4ffd14678-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-de905158-bd74-4911-afa5-8fb4ffd14678" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:42 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f Sep 09 18:06:42 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-de905158-bd74-4911-afa5-8fb4ffd14678" acquired by "delete_volume" :: waited 0.039s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371b437-c79a-4caa-b636-bd27d8ae90fe]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:43 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 Sep 09 18:06:43 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:43 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" returned: 0 in 0.452s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:43 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 1G Sep 09 18:06:43 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:43 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678" returned: 0 in 0.431s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:43 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678 Sep 09 18:06:43 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:43 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-de905158-bd74-4911-afa5-8fb4ffd14678" returned: 0 in 0.332s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-de905158-bd74-4911-afa5-8fb4ffd14678" released by "delete_volume" :: held 0.848s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:43 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 1G" returned: 0 in 0.599s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:43 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 Sep 09 18:06:43 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:43 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Created reservations ['a59d6569-4282-4171-836a-976e67d0906b', 'd5466bc3-481b-41a4-9b15-11d0b44e71df', '3ee363a4-c645-4a7e-bc0d-b7aaf3d0daf3', 'de1014b9-e719-459c-a9e9-569de9334884'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:44 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:44 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:44 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3" returned: 0 in 0.404s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:44 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 is being set with open permissions: ugo+rw Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:44 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 Sep 09 18:06:44 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:44 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.339s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:44 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-e12ae5b2-b850-4f09-a534-0f95b39a08c3 tempest-ProjectMemberTests-805547256 None] Lock "cinder-de905158-bd74-4911-afa5-8fb4ffd14678-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:44 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3" returned: 0 in 0.329s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:44 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.info Sep 09 18:06:44 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (34bacef9-e855-4463-b91e-4ce0f06e6340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a14efb-1c50-41bd-8f19-43318df58d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a14efb-1c50-41bd-8f19-43318df58d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112029223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7dd100-d538-4e3d-a89a-21447c652fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:45Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6c6cde-90f2-4df2-b741-c5b42bedab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6c6cde-90f2-4df2-b741-c5b42bedab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fbd1ce-dbb2-4f9f-8eab-86bca94fc94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fbd1ce-dbb2-4f9f-8eab-86bca94fc94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7dd100-d538-4e3d-a89a-21447c652fc6', 'volume_name': 'volume-bf7dd100-d538-4e3d-a89a-21447c652fc6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2288376f-00a8-448a-b391-f37c06c93248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2288376f-00a8-448a-b391-f37c06c93248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21f8c07-3240-4840-a274-0474a3ca2d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:44 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Volume bf7dd100-d538-4e3d-a89a-21447c652fc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7dd100-d538-4e3d-a89a-21447c652fc6', 'volume_size': 1} Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:44 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.info" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:44 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.info is being set with open permissions: ugo+rw Sep 09 18:06:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:44 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.info Sep 09 18:06:44 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:45 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.info" returned: 0 in 0.312s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.495s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1112029223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7dd100-d538-4e3d-a89a-21447c652fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:45Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Creating volume bf7dd100-d538-4e3d-a89a-21447c652fc6 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:45 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:45 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 1073741824 Sep 09 18:06:45 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-26aa7a89-bf7a-429d-9ffa-4874bfb7ac6b tempest-SnapshotDependencyTests-245955263 None] Create snapshot completed successfully Sep 09 18:06:45 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 1073741824" returned: 0 in 0.486s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:45 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 Sep 09 18:06:45 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:46 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6" returned: 0 in 0.275s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21f8c07-3240-4840-a274-0474a3ca2d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7dd100-d538-4e3d-a89a-21447c652fc6', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c1e809-2286-4944-88f4-aaa9a531133c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Volume volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 (bf7dd100-d538-4e3d-a89a-21447c652fc6): created successfully Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c1e809-2286-4944-88f4-aaa9a531133c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (34bacef9-e855-4463-b91e-4ce0f06e6340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:46 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e9cdc2ed-33be-451f-8605-56ebf1cb5bdd tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Flow 'volume_create_manager' (a5a35e4b-8b45-44b6-b9d7-fbd79033a651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a50e51f-d7e2-4102-afcf-15bd17238499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a50e51f-d7e2-4102-afcf-15bd17238499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3efd062-b1dc-4344-a17c-f1a8cea5e8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8b7ff7e1324824994fc2a9331bc6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01d8b511-ead5-4cd4-86f1-5003e10d44a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:46Z,use_quota=True,user_id='833b30eb52924890a1471595bafad645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f7a369-61d1-4ca1-8f54-e3c537928fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f7a369-61d1-4ca1-8f54-e3c537928fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418433a1-5586-4ef5-b37b-0818db445fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418433a1-5586-4ef5-b37b-0818db445fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3efd062-b1dc-4344-a17c-f1a8cea5e8e9', 'volume_name': 'volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9', 'volume_size': 1, 'snapshot_id': '01d8b511-ead5-4cd4-86f1-5003e10d44a3'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8509129d-abe6-4d66-9be0-f531a2e2c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8509129d-abe6-4d66-9be0-f531a2e2c323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408e06f2-81ce-4284-b2b6-c95974ee1fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:46 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Volume c3efd062-b1dc-4344-a17c-f1a8cea5e8e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9', 'volume_size': 1, 'snapshot_id': '01d8b511-ead5-4cd4-86f1-5003e10d44a3'} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-quobyte-01d8b511-ead5-4cd4-86f1-5003e10d44a3-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" by "_create_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-01d8b511-ead5-4cd4-86f1-5003e10d44a3-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Creating volume c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 from snapshot 01d8b511-ead5-4cd4-86f1-5003e10d44a3 {{(pid=87202) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-quobyte-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" by "_copy_volume_from_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] snapshot: 01d8b511-ead5-4cd4-86f1-5003e10d44a3, volume: c3efd062-b1dc-4344-a17c-f1a8cea5e8e9, {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f527caf2-f804-4017-935d-494302908e88]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:46 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 Sep 09 18:06:46 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:47 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3" returned: 0 in 0.383s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4180c151-cb6b-4760-8fbd-53da6c620972]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:47 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f Sep 09 18:06:47 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:47 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" returned: 0 in 0.369s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Creating direct copy from snapshot {{(pid=87202) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG cinder.utils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Path /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 not found in is_blk_device check {{(pid=87202) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:06:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:47 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 Sep 09 18:06:47 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:51 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" returned: 0 in 4.586s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:51 devstack cinder-volume[87202]: DEBUG cinder.image.image_utils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f, size 1024.00 MB, duration 4.59 sec, destination /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 {{(pid=87202) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:06:51 devstack cinder-volume[87202]: INFO cinder.image.image_utils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Converted 1024.00 MB image at 223.19 MB/s Sep 09 18:06:51 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 is being set with open permissions: ugo+rw Sep 09 18:06:51 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:52 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 Sep 09 18:06:52 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:52 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" released by "_copy_volume_from_snapshot" :: held 5.691s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-01d8b511-ead5-4cd4-86f1-5003e10d44a3-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" released by "_create_volume_from_snapshot" :: held 5.751s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.766s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.417s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Creating offline snapshot 68c5e40b-8485-4212-8bb1-40ef25fc6508 of volume bf7dd100-d538-4e3d-a89a-21447c652fc6 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408e06f2-81ce-4284-b2b6-c95974ee1fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9', 'volume_size': 1, 'snapshot_id': '01d8b511-ead5-4cd4-86f1-5003e10d44a3'}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d301e59f-aee5-4ef6-acf3-c82fb1364311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[09058b63-0a0d-4c7b-b389-9656b962eeed]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:52 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Volume volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 (c3efd062-b1dc-4344-a17c-f1a8cea5e8e9): created successfully Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d301e59f-aee5-4ef6-acf3-c82fb1364311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Flow 'volume_create_manager' (a5a35e4b-8b45-44b6-b9d7-fbd79033a651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:52 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-7510ec90-0950-4b69-853d-b9deac7293e4 tempest-SnapshotDependencyTests-245955263 None] Created volume successfully. Sep 09 18:06:52 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 Sep 09 18:06:52 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:52 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:52 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 1G Sep 09 18:06:52 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-01d8b511-ead5-4cd4-86f1-5003e10d44a3-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-01d8b511-ead5-4cd4-86f1-5003e10d44a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-quobyte-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-quobyte-01d8b511-ead5-4cd4-86f1-5003e10d44a3" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-01d8b511-ead5-4cd4-86f1-5003e10d44a3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Deleting offline snapshot 01d8b511-ead5-4cd4-86f1-5003e10d44a3 of volume 559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:06:53 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] snapshot_file for this snap is: volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 1G" returned: 0 in 0.512s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d2308-24b2-4006-b5f2-bccc6284bd8b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:53 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 Sep 09 18:06:53 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:53 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 Sep 09 18:06:53 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:53 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508" returned: 0 in 0.325s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:53 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 is being set with open permissions: ugo+rw Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:53 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 Sep 09 18:06:53 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:53 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3" returned: 0 in 0.417s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[857bf68c-1842-456a-832c-3e21c24035ac]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:53 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f Sep 09 18:06:53 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:53 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508" returned: 0 in 0.281s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:53 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.info Sep 09 18:06:53 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:54 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.info" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:54 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.info is being set with open permissions: ugo+rw Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:54 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.info Sep 09 18:06:54 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:54 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" returned: 0 in 0.573s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:54 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 Sep 09 18:06:54 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:54 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.info" returned: 0 in 0.299s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:54 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0520598d-0335-45e2-bd61-b45c6b78b6d2 tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:06:54 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3" returned: 0 in 0.390s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:54 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3 Sep 09 18:06:54 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:54 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f.01d8b511-ead5-4cd4-86f1-5003e10d44a3" returned: 0 in 0.261s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-01d8b511-ead5-4cd4-86f1-5003e10d44a3" released by "_delete_snapshot" :: held 1.779s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:54 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" released by "delete_snapshot" :: held 1.809s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Created reservations ['11aa784f-7c69-4595-a5a9-42a5d584ae30', 'a2f388eb-9bdd-4a0d-91d7-370418e63dfa', '1694aa19-341d-4764-8924-6849649aedba', '6996e9cf-250d-4990-982d-fb8fdfec881c'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Delete snapshot completed successfully. Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-10b77186-2184-46bd-aa03-d63b30b121cb tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-01d8b511-ead5-4cd4-86f1-5003e10d44a3-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-559013a3-f9c9-4c65-b7bb-e608aef5aa7f-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-559013a3-f9c9-4c65-b7bb-e608aef5aa7f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-68c5e40b-8485-4212-8bb1-40ef25fc6508-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Lock "cinder-68c5e40b-8485-4212-8bb1-40ef25fc6508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-bf7dd100-d538-4e3d-a89a-21447c652fc6" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-quobyte-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-bf7dd100-d538-4e3d-a89a-21447c652fc6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-68c5e40b-8485-4212-8bb1-40ef25fc6508" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-68c5e40b-8485-4212-8bb1-40ef25fc6508" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot 68c5e40b-8485-4212-8bb1-40ef25fc6508 of volume bf7dd100-d538-4e3d-a89a-21447c652fc6 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[854c3fd2-59bc-44d7-a2d6-1f7bf10416f7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd167c4b-33cf-4c50-a920-6e047e99b071]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:55 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f Sep 09 18:06:55 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:55 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 Sep 09 18:06:55 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:55 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" returned: 0 in 0.402s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:55 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508" returned: 0 in 0.405s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf7dd100-d538-4e3d-a89a-21447c652fc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:06:55 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f Sep 09 18:06:55 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d910ef8a-ce8d-4cbb-abe2-7fa80e358705]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:56 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 Sep 09 18:06:56 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:56 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" returned: 0 in 0.270s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-559013a3-f9c9-4c65-b7bb-e608aef5aa7f" released by "delete_volume" :: held 0.755s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Created reservations ['25d0e069-ad16-40a7-bad3-ce60581cc04a', '24572bd0-d2e9-4ea2-811e-16fd49c13a87', '39a7113a-1b1d-479b-a3b7-e33274e22b85', '009c0e3a-5995-47e4-8c56-66cda3646fcd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:56 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6" returned: 0 in 0.400s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:56 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:56 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:56 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 Sep 09 18:06:56 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "cinder-quobyte-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" acquired by "delete_volume" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d34458a-7bc0-4aa3-b049-29b122ec809f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:56 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:56 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Deleted volume successfully. Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-8286768f-a670-4abb-8b57-20357123ca14 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-559013a3-f9c9-4c65-b7bb-e608aef5aa7f-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:56 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 Sep 09 18:06:56 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:56 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508" returned: 0 in 0.453s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:56 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508 Sep 09 18:06:56 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:57 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" returned: 0 in 0.387s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:57 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6.68c5e40b-8485-4212-8bb1-40ef25fc6508" returned: 0 in 0.266s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:57 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9 Sep 09 18:06:57 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-68c5e40b-8485-4212-8bb1-40ef25fc6508" released by "_delete_snapshot" :: held 1.650s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-bf7dd100-d538-4e3d-a89a-21447c652fc6" released by "delete_snapshot" :: held 1.705s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Created reservations ['5b62d003-4f79-4dd4-8cd9-b338bb5bf6c1', 'ecea6fee-5d6b-4229-8b81-00ada05670fa', '402d051f-1d91-4cdc-8544-8defd702a3fd', 'ab69301a-6600-4a00-8761-ba0d17a735f0'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dd71c65b-018d-4fb1-8bea-23fc9274a4be tempest-ProjectMemberTests-805547256 None] Lock "cinder-68c5e40b-8485-4212-8bb1-40ef25fc6508-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:57 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" returned: 0 in 0.250s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-quobyte-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9" released by "delete_volume" :: held 0.686s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Created reservations ['1bcb1ac0-480e-4dad-8aaf-b33f32e832b2', '111653f5-e39b-4e74-9a59-88d59504d7ed', '2c377719-f134-4b36-bab7-f6f361fef216', '64082a33-bada-4311-90d3-83b7817cb148'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:57 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:57 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-bf7dd100-d538-4e3d-a89a-21447c652fc6-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Lock "cinder-bf7dd100-d538-4e3d-a89a-21447c652fc6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-bf7dd100-d538-4e3d-a89a-21447c652fc6" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-bf7dd100-d538-4e3d-a89a-21447c652fc6" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:06:57 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.281s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Deleted volume successfully. Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccab63c-aad7-4fbf-b4f7-27b03ae81f89]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-791aae35-e6d1-4f04-95de-76964bf1c755 tempest-SnapshotDependencyTests-245955263 None] Lock "cinder-c3efd062-b1dc-4344-a17c-f1a8cea5e8e9-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:57 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 Sep 09 18:06:57 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:58 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6" returned: 0 in 0.398s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:58 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6 Sep 09 18:06:58 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:58 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bf7dd100-d538-4e3d-a89a-21447c652fc6" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-bf7dd100-d538-4e3d-a89a-21447c652fc6" released by "delete_volume" :: held 0.722s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Created reservations ['7a94b06c-9a34-47a6-ac7f-70063b193241', '9994a39b-0afb-4125-84e5-6c8dd3fbe0b7', 'ee3c340c-6159-42fd-a60f-c058ef992623', 'ac620b33-d332-42f4-913a-013af2823afb'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:58 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:06:58 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:58 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:58 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:06:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-98da6f4e-ea51-41a8-9ad7-59858255bca7 tempest-ProjectMemberTests-805547256 None] Lock "cinder-bf7dd100-d538-4e3d-a89a-21447c652fc6-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (910a1b41-7f48-4391-92a3-409fccf0d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32576667-aed6-46b3-96da-c2dab40e4730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32576667-aed6-46b3-96da-c2dab40e4730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1728084897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcce796a-edca-4da8-a230-5b6055fcae53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:59Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cfe86d-95b6-4ec2-9ab5-4430076d37ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2cfe86d-95b6-4ec2-9ab5-4430076d37ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bf4856-035d-407b-9bcc-edb57c6eaf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bf4856-035d-407b-9bcc-edb57c6eaf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcce796a-edca-4da8-a230-5b6055fcae53', 'volume_name': 'volume-bcce796a-edca-4da8-a230-5b6055fcae53', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60ed729-e64b-4a83-9b04-4822e72cd6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60ed729-e64b-4a83-9b04-4822e72cd6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a080e2-be75-4043-befa-46a05b6945e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:06:59 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Volume bcce796a-edca-4da8-a230-5b6055fcae53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcce796a-edca-4da8-a230-5b6055fcae53', 'volume_size': 1} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1728084897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcce796a-edca-4da8-a230-5b6055fcae53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:06:59Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Creating volume bcce796a-edca-4da8-a230-5b6055fcae53 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:06:59 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:59 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 1073741824 Sep 09 18:06:59 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:59 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 1073741824" returned: 0 in 0.407s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:59 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 Sep 09 18:06:59 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:00 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53" returned: 0 in 0.284s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a080e2-be75-4043-befa-46a05b6945e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcce796a-edca-4da8-a230-5b6055fcae53', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2d25b1-4ff4-4a66-9dfd-584bbecf4bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Volume volume-bcce796a-edca-4da8-a230-5b6055fcae53 (bcce796a-edca-4da8-a230-5b6055fcae53): created successfully Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2d25b1-4ff4-4a66-9dfd-584bbecf4bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (910a1b41-7f48-4391-92a3-409fccf0d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e51653e9-03a6-4bd7-972d-2a86cbcb95fc tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Creating offline snapshot a0887cf7-eff5-400b-8f97-c9b3832a3b52 of volume bcce796a-edca-4da8-a230-5b6055fcae53 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7528e3-2ac7-4170-9edd-21445a653140]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:00 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 Sep 09 18:07:00 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:00 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:00 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 1G Sep 09 18:07:00 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:01 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 1G" returned: 0 in 0.404s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcce796a-edca-4da8-a230-5b6055fcae53 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:01 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcce796a-edca-4da8-a230-5b6055fcae53 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 Sep 09 18:07:01 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:01 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcce796a-edca-4da8-a230-5b6055fcae53 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52" returned: 0 in 0.281s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:01 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 is being set with open permissions: ugo+rw Sep 09 18:07:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:01 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 Sep 09 18:07:01 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:01 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:01 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.info Sep 09 18:07:01 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:02 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.info" returned: 0 in 0.293s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:02 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.info is being set with open permissions: ugo+rw Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:02 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.info Sep 09 18:07:02 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:02 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.info" returned: 0 in 0.259s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:02 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4b6a482d-148b-43f8-9ffe-65fb2c66c510 tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-a0887cf7-eff5-400b-8f97-c9b3832a3b52-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Lock "cinder-a0887cf7-eff5-400b-8f97-c9b3832a3b52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-bcce796a-edca-4da8-a230-5b6055fcae53" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-bcce796a-edca-4da8-a230-5b6055fcae53" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-a0887cf7-eff5-400b-8f97-c9b3832a3b52" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-a0887cf7-eff5-400b-8f97-c9b3832a3b52" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot a0887cf7-eff5-400b-8f97-c9b3832a3b52 of volume bcce796a-edca-4da8-a230-5b6055fcae53 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[92766a2c-d3bd-47d8-8410-a32b936ae608]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:02 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 Sep 09 18:07:02 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:03 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52" returned: 0 in 0.415s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcce796a-edca-4da8-a230-5b6055fcae53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:07:03 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16a7ac1-4b9c-408e-9e63-97a401840294]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:03 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 Sep 09 18:07:03 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:03 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53" returned: 0 in 0.370s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:03 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 Sep 09 18:07:03 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:03 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52" returned: 0 in 0.353s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:03 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52 Sep 09 18:07:03 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:04 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53.a0887cf7-eff5-400b-8f97-c9b3832a3b52" returned: 0 in 0.257s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-a0887cf7-eff5-400b-8f97-c9b3832a3b52" released by "_delete_snapshot" :: held 1.516s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-bcce796a-edca-4da8-a230-5b6055fcae53" released by "delete_snapshot" :: held 1.540s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Created reservations ['6ec6c9f8-709c-4de7-833c-a5dcc0730552', '2e36c432-7467-4458-ada3-cf3cc7a7185c', 'e57a6c1c-546f-4c18-b3c6-fea93e390097', 'f49cf5b6-8572-4bd2-ae23-6d82a1e4a1ba'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:04 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-d905cbf0-472e-43ff-a855-8981775b753b tempest-ProjectMemberTests-805547256 None] Lock "cinder-a0887cf7-eff5-400b-8f97-c9b3832a3b52-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-bcce796a-edca-4da8-a230-5b6055fcae53-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Lock "cinder-bcce796a-edca-4da8-a230-5b6055fcae53-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-bcce796a-edca-4da8-a230-5b6055fcae53" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-bcce796a-edca-4da8-a230-5b6055fcae53" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76e29d-3523-4874-89b9-ef57975c306d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:04 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 Sep 09 18:07:05 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:05 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:05 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:05 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53" returned: 0 in 0.429s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:05 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.291s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:07:05 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53 Sep 09 18:07:05 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:05 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-bcce796a-edca-4da8-a230-5b6055fcae53" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-bcce796a-edca-4da8-a230-5b6055fcae53" released by "delete_volume" :: held 0.739s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Created reservations ['5a8a7280-4ebd-4364-b240-5cf116c53833', 'c5db2ec8-df9c-4543-b700-33d05ff18fb0', '0e3706af-cd7b-4731-86ca-6bba69f7c910', 'c171169a-cee2-494d-a978-45e238280ac5'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:05 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:05 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:05 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.266s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:05 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ec0ef60b-74a1-4349-984c-39a1b31099ac tempest-ProjectMemberTests-805547256 None] Lock "cinder-bcce796a-edca-4da8-a230-5b6055fcae53-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (7e507020-482e-4054-a06d-bae2c682562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae207f14-f88e-4b1c-b581-3f03c94ce678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae207f14-f88e-4b1c-b581-3f03c94ce678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429078480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07217f69-7e39-4a7a-91aa-dc62446171ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:06Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0abe6f4-4006-485b-9831-c4e8bcff9dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0abe6f4-4006-485b-9831-c4e8bcff9dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2741a38-345b-48c4-a5be-8506114e9d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2741a38-345b-48c4-a5be-8506114e9d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07217f69-7e39-4a7a-91aa-dc62446171ab', 'volume_name': 'volume-07217f69-7e39-4a7a-91aa-dc62446171ab', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63dbecce-b408-4894-adfe-ca44c0322ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63dbecce-b408-4894-adfe-ca44c0322ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eede29fa-4fab-4661-bbdf-5273a1a338ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:06 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Volume 07217f69-7e39-4a7a-91aa-dc62446171ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07217f69-7e39-4a7a-91aa-dc62446171ab', 'volume_size': 1} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429078480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07217f69-7e39-4a7a-91aa-dc62446171ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:06Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Creating volume 07217f69-7e39-4a7a-91aa-dc62446171ab {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:07:06 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:07:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:06 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab 1073741824 Sep 09 18:07:06 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:07 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab 1073741824" returned: 0 in 0.488s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:07 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab Sep 09 18:07:07 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:07 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eede29fa-4fab-4661-bbdf-5273a1a338ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07217f69-7e39-4a7a-91aa-dc62446171ab', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c820bde-bccf-4fbb-a42f-120f32a729cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:07 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Volume volume-07217f69-7e39-4a7a-91aa-dc62446171ab (07217f69-7e39-4a7a-91aa-dc62446171ab): created successfully Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c820bde-bccf-4fbb-a42f-120f32a729cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (7e507020-482e-4054-a06d-bae2c682562b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:07 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9a365436-146e-47a0-9a55-fb46738bbe5c tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:07:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Creating offline snapshot a69b8b13-43db-4d9f-8d61-236d40a97dc6 of volume 07217f69-7e39-4a7a-91aa-dc62446171ab {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:07:08 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[329279b4-00be-47be-9c82-d33f91c5cd3f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:08 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab Sep 09 18:07:08 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:09 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab" returned: 0 in 0.354s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:09 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 1G Sep 09 18:07:09 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:09 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 1G" returned: 0 in 0.379s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07217f69-7e39-4a7a-91aa-dc62446171ab -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:09 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07217f69-7e39-4a7a-91aa-dc62446171ab -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 Sep 09 18:07:09 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:09 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07217f69-7e39-4a7a-91aa-dc62446171ab -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6" returned: 0 in 0.285s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:09 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 is being set with open permissions: ugo+rw Sep 09 18:07:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:09 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 Sep 09 18:07:09 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:10 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:10 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.info Sep 09 18:07:10 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:10 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.info" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:10 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.info is being set with open permissions: ugo+rw Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:10 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.info Sep 09 18:07:10 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:10 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.info" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:10 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9846de39-6b8b-46c9-8b8a-427089519c10 tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-a69b8b13-43db-4d9f-8d61-236d40a97dc6-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Lock "cinder-a69b8b13-43db-4d9f-8d61-236d40a97dc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-07217f69-7e39-4a7a-91aa-dc62446171ab" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-07217f69-7e39-4a7a-91aa-dc62446171ab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-a69b8b13-43db-4d9f-8d61-236d40a97dc6" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-a69b8b13-43db-4d9f-8d61-236d40a97dc6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot a69b8b13-43db-4d9f-8d61-236d40a97dc6 of volume 07217f69-7e39-4a7a-91aa-dc62446171ab {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e213d4cd-fbdf-4635-9b16-9d72f26cbb3f]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:11 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 Sep 09 18:07:11 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:11 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6" returned: 0 in 0.379s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:11 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07217f69-7e39-4a7a-91aa-dc62446171ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:07:11 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c7c737-2c8f-447b-b4e1-6f5075100e90]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:11 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab Sep 09 18:07:11 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:11 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab" returned: 0 in 0.339s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:11 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 Sep 09 18:07:11 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:11 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6" returned: 0 in 0.322s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:11 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6 Sep 09 18:07:12 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:12 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab.a69b8b13-43db-4d9f-8d61-236d40a97dc6" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-a69b8b13-43db-4d9f-8d61-236d40a97dc6" released by "_delete_snapshot" :: held 1.368s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-07217f69-7e39-4a7a-91aa-dc62446171ab" released by "delete_snapshot" :: held 1.388s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:12 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Created reservations ['1e7dfaef-ba0e-4d5d-b9a2-73f2264968cb', '222a79d3-d924-4f92-898a-a4a5bd5dd841', '43213ce5-61f4-437f-ab92-67721ffd8843', '228f07f1-074b-4d5d-954c-eb22727040f5'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:12 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:07:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26b2395e-cb50-49b2-8daf-3187c432be40 tempest-ProjectMemberTests-805547256 None] Lock "cinder-a69b8b13-43db-4d9f-8d61-236d40a97dc6-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-07217f69-7e39-4a7a-91aa-dc62446171ab-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Lock "cinder-07217f69-7e39-4a7a-91aa-dc62446171ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-07217f69-7e39-4a7a-91aa-dc62446171ab" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-07217f69-7e39-4a7a-91aa-dc62446171ab" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0bed80-7413-47a6-a4ad-613a46ee6c7a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:13 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab Sep 09 18:07:13 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:13 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab" returned: 0 in 0.352s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:13 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab Sep 09 18:07:13 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:13 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-07217f69-7e39-4a7a-91aa-dc62446171ab" returned: 0 in 0.242s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-07217f69-7e39-4a7a-91aa-dc62446171ab" released by "delete_volume" :: held 0.642s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Created reservations ['8ea4f23e-9dbb-411a-97af-31254b5918ab', 'd7e338a4-326c-4fa9-8e19-3005635320c4', '68171a09-dd23-4285-86c7-096c8b5342a3', 'fdc85ed3-60f9-4ccd-8506-6c42ec12845b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:13 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:13 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:14 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.254s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:14 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-79a8b9db-0467-430a-b64f-cb95472e7657 tempest-ProjectMemberTests-805547256 None] Lock "cinder-07217f69-7e39-4a7a-91aa-dc62446171ab-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (3a141d35-f72a-4c74-b73c-d6d5f7101966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a63a3db-300a-4838-b162-7f572ccc1c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a63a3db-300a-4838-b162-7f572ccc1c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422382502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfc493f-65f8-4a28-8c99-5d50276e8503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:15Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0e5de1-1c48-4d97-8cbb-53f2faebbbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc0e5de1-1c48-4d97-8cbb-53f2faebbbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af64718-c22c-4603-89ce-b9baef3787cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af64718-c22c-4603-89ce-b9baef3787cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bfc493f-65f8-4a28-8c99-5d50276e8503', 'volume_name': 'volume-2bfc493f-65f8-4a28-8c99-5d50276e8503', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8109c1ad-374e-46ea-97f6-e2934c76cfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8109c1ad-374e-46ea-97f6-e2934c76cfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9bb00a-3f2c-4e7e-aaf6-0b15258ca959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Volume 2bfc493f-65f8-4a28-8c99-5d50276e8503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bfc493f-65f8-4a28-8c99-5d50276e8503', 'volume_size': 1} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422382502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfc493f-65f8-4a28-8c99-5d50276e8503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:15Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Creating volume 2bfc493f-65f8-4a28-8c99-5d50276e8503 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:07:14 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:07:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:14 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 1073741824 Sep 09 18:07:14 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:15 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 1073741824" returned: 0 in 0.406s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:15 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 Sep 09 18:07:15 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:15 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9bb00a-3f2c-4e7e-aaf6-0b15258ca959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bfc493f-65f8-4a28-8c99-5d50276e8503', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede7f749-1480-4e2b-8e1c-514a6d97aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:15 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Volume volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 (2bfc493f-65f8-4a28-8c99-5d50276e8503): created successfully Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede7f749-1480-4e2b-8e1c-514a6d97aa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (3a141d35-f72a-4c74-b73c-d6d5f7101966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ce393d51-835d-4c1a-ab7d-e01bb005a649 tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Creating offline snapshot c90af901-ebd0-4379-9a14-73b0d46e3722 of volume 2bfc493f-65f8-4a28-8c99-5d50276e8503 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b61c94f-2956-461b-9b96-be5a17e9b0dd]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:15 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 Sep 09 18:07:15 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:16 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503" returned: 0 in 0.353s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:16 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 1G Sep 09 18:07:16 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:16 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 1G" returned: 0 in 0.380s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:16 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 Sep 09 18:07:16 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:16 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722" returned: 0 in 0.296s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:16 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 is being set with open permissions: ugo+rw Sep 09 18:07:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:16 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 Sep 09 18:07:16 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:17 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:17 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.info Sep 09 18:07:17 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:17 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.info" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:17 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.info is being set with open permissions: ugo+rw Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:17 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.info Sep 09 18:07:17 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:17 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.info" returned: 0 in 0.243s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-327389a7-c39f-4754-8b55-c198072763a4 tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-c90af901-ebd0-4379-9a14-73b0d46e3722-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Lock "cinder-c90af901-ebd0-4379-9a14-73b0d46e3722-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-2bfc493f-65f8-4a28-8c99-5d50276e8503" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-2bfc493f-65f8-4a28-8c99-5d50276e8503" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-c90af901-ebd0-4379-9a14-73b0d46e3722" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-c90af901-ebd0-4379-9a14-73b0d46e3722" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot c90af901-ebd0-4379-9a14-73b0d46e3722 of volume 2bfc493f-65f8-4a28-8c99-5d50276e8503 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6214f096-e452-4713-a870-c2ca393a0070]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:18 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 Sep 09 18:07:18 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:18 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722" returned: 0 in 0.358s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:18 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bfc493f-65f8-4a28-8c99-5d50276e8503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:07:18 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a4980-fba2-4768-b7ea-1d4108b743f5]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:18 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 Sep 09 18:07:18 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:18 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:18 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 Sep 09 18:07:18 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:19 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722" returned: 0 in 0.336s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:19 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722 Sep 09 18:07:19 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:19 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503.c90af901-ebd0-4379-9a14-73b0d46e3722" returned: 0 in 0.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-c90af901-ebd0-4379-9a14-73b0d46e3722" released by "_delete_snapshot" :: held 1.383s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-2bfc493f-65f8-4a28-8c99-5d50276e8503" released by "delete_snapshot" :: held 1.407s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:19 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Created reservations ['cb035c98-6b6a-47ff-b6ca-6c08e5e3ef5b', '96383e15-a71c-4cfb-a1d6-d23cd8a7865b', '2c6b13e0-f895-4ae6-8882-a35138271ff6', 'd4bfa2df-6d26-4b29-a299-6070fe4b62db'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:19 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:07:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ffa8131a-c2ac-4457-a753-e0830df57e39 tempest-ProjectMemberTests-805547256 None] Lock "cinder-c90af901-ebd0-4379-9a14-73b0d46e3722-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-2bfc493f-65f8-4a28-8c99-5d50276e8503-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Lock "cinder-2bfc493f-65f8-4a28-8c99-5d50276e8503-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-2bfc493f-65f8-4a28-8c99-5d50276e8503" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-2bfc493f-65f8-4a28-8c99-5d50276e8503" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[6067f224-b189-475e-b70b-36b801b990a0]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:20 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 Sep 09 18:07:20 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:20 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503" returned: 0 in 0.365s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:20 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503 Sep 09 18:07:20 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:20 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-2bfc493f-65f8-4a28-8c99-5d50276e8503" returned: 0 in 0.234s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-2bfc493f-65f8-4a28-8c99-5d50276e8503" released by "delete_volume" :: held 0.654s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Created reservations ['fcad1e8c-7140-4381-8ac3-6f9834c118ef', '10e70465-3328-4274-ab20-e7080d823f62', '908fc492-0202-49a7-8e88-3f8227024d49', 'aef452a9-22a7-4a81-9d44-5d261f12ad3b'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:20 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:20 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:21 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:21 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-26a4f4ff-4967-492a-9c20-89a9460c4ff1 tempest-ProjectMemberTests-805547256 None] Lock "cinder-2bfc493f-65f8-4a28-8c99-5d50276e8503-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (bb91e349-df82-45cb-8b4c-0e73c6877f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8d7e5e-ecf6-4b61-a82d-c0df2752c86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c8d7e5e-ecf6-4b61-a82d-c0df2752c86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167764330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411db1ef-41cc-4c7b-a491-15d6499946eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:22Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4e619-74d6-440a-96fe-a9ac0d00d707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4e619-74d6-440a-96fe-a9ac0d00d707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3eb8fde-c9d0-4c42-8501-dc53c530caa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3eb8fde-c9d0-4c42-8501-dc53c530caa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411db1ef-41cc-4c7b-a491-15d6499946eb', 'volume_name': 'volume-411db1ef-41cc-4c7b-a491-15d6499946eb', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c97736-b6d6-4802-b868-7f32f0bfb20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c97736-b6d6-4802-b868-7f32f0bfb20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d7a905-1d0f-466e-96cb-dbd42ca151f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:21 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Volume 411db1ef-41cc-4c7b-a491-15d6499946eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411db1ef-41cc-4c7b-a491-15d6499946eb', 'volume_size': 1} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1167764330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411db1ef-41cc-4c7b-a491-15d6499946eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:22Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Creating volume 411db1ef-41cc-4c7b-a491-15d6499946eb {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:07:21 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:07:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:21 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb 1073741824 Sep 09 18:07:21 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:22 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb 1073741824" returned: 0 in 0.431s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:22 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb Sep 09 18:07:22 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:22 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb" returned: 0 in 0.255s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d7a905-1d0f-466e-96cb-dbd42ca151f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411db1ef-41cc-4c7b-a491-15d6499946eb', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b22c52-e0f1-48e6-b2ac-91f0a66fc490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:22 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Volume volume-411db1ef-41cc-4c7b-a491-15d6499946eb (411db1ef-41cc-4c7b-a491-15d6499946eb): created successfully Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b22c52-e0f1-48e6-b2ac-91f0a66fc490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (bb91e349-df82-45cb-8b4c-0e73c6877f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0a9cd473-859b-4c06-bcb3-38fbb125f274 tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Creating offline snapshot 2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 of volume 411db1ef-41cc-4c7b-a491-15d6499946eb {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d69a9d2-2e58-472e-b787-0127379d59b9]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:22 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb Sep 09 18:07:22 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:23 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:23 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 1G Sep 09 18:07:23 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:23 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 1G" returned: 0 in 0.388s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-411db1ef-41cc-4c7b-a491-15d6499946eb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:23 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-411db1ef-41cc-4c7b-a491-15d6499946eb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 Sep 09 18:07:23 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:23 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-411db1ef-41cc-4c7b-a491-15d6499946eb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01" returned: 0 in 0.284s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:23 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 is being set with open permissions: ugo+rw Sep 09 18:07:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:23 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 Sep 09 18:07:23 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:24 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01" returned: 0 in 0.239s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:24 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.info Sep 09 18:07:24 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:24 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.info" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:24 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.info is being set with open permissions: ugo+rw Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:24 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.info Sep 09 18:07:24 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:24 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.info" returned: 0 in 0.251s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ed7c52e8-7135-4c5f-a36e-12db15e17a3c tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-2bbacc68-4a31-4d94-a9d7-e7509dd8ac01-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Lock "cinder-2bbacc68-4a31-4d94-a9d7-e7509dd8ac01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-411db1ef-41cc-4c7b-a491-15d6499946eb" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-411db1ef-41cc-4c7b-a491-15d6499946eb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-2bbacc68-4a31-4d94-a9d7-e7509dd8ac01" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-2bbacc68-4a31-4d94-a9d7-e7509dd8ac01" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot 2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 of volume 411db1ef-41cc-4c7b-a491-15d6499946eb {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73ca8c-c234-4ea7-ac0e-3488d444fc78]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:25 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 Sep 09 18:07:25 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:25 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01" returned: 0 in 0.373s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-411db1ef-41cc-4c7b-a491-15d6499946eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33406fe-af37-4f75-82ad-33b56ad46a5c]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:25 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb Sep 09 18:07:25 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:25 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb" returned: 0 in 0.342s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:25 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 Sep 09 18:07:25 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:26 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01" returned: 0 in 0.342s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:26 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01 Sep 09 18:07:26 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:26 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb.2bbacc68-4a31-4d94-a9d7-e7509dd8ac01" returned: 0 in 0.263s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-2bbacc68-4a31-4d94-a9d7-e7509dd8ac01" released by "_delete_snapshot" :: held 1.412s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-411db1ef-41cc-4c7b-a491-15d6499946eb" released by "delete_snapshot" :: held 1.435s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:26 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Created reservations ['c411bab8-c70a-4e84-9a3b-3ebdc4cce4ba', '6e7775e3-42f2-4ab4-9718-a3de96369f75', '8257e3f7-b7f0-4ba7-ba12-be3ee712fff8', '22468bbb-e9d3-4882-a797-bf9bab355a75'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:26 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:07:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-dbf6ed13-2072-43cb-8e7a-0ebc8e8feb18 tempest-ProjectMemberTests-805547256 None] Lock "cinder-2bbacc68-4a31-4d94-a9d7-e7509dd8ac01-delete_snapshot" released by "delete_snapshot" :: held 1.566s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-411db1ef-41cc-4c7b-a491-15d6499946eb-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Lock "cinder-411db1ef-41cc-4c7b-a491-15d6499946eb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-411db1ef-41cc-4c7b-a491-15d6499946eb" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-411db1ef-41cc-4c7b-a491-15d6499946eb" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9452b8b-48e2-4316-9ca6-3d0baf756db1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:27 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb Sep 09 18:07:27 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:27 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb" returned: 0 in 0.358s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:27 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb Sep 09 18:07:27 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:27 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-411db1ef-41cc-4c7b-a491-15d6499946eb" returned: 0 in 0.233s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-411db1ef-41cc-4c7b-a491-15d6499946eb" released by "delete_volume" :: held 0.644s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Created reservations ['a6e9211c-68cc-4f53-9087-807d70993471', '5ae108f8-3ef1-4f7a-a400-887fd00263a7', 'cddc8a70-59e3-43d4-9e16-839686e36066', '41c1b08c-b29f-413d-a613-916fabf827ac'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:27 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:27 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:28 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:28 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-c5a2be73-7159-4cbc-8eb5-9b91f0afed7f tempest-ProjectMemberTests-805547256 None] Lock "cinder-411db1ef-41cc-4c7b-a491-15d6499946eb-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (aacca9ec-dcca-4ddc-b61e-47364c0c6887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b60242-5203-48d4-8640-451ead6d9ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b60242-5203-48d4-8640-451ead6d9ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302498070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bd1df8-f957-4e16-bc80-dab9ba595b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:29Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3914674f-bd86-47d0-8029-257d1cc37c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3914674f-bd86-47d0-8029-257d1cc37c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0157bb-f8d6-4edb-b372-49ad071b0c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0157bb-f8d6-4edb-b372-49ad071b0c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3bd1df8-f957-4e16-bc80-dab9ba595b18', 'volume_name': 'volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa75b62a-f07d-4ebc-9043-7cc4249b33f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa75b62a-f07d-4ebc-9043-7cc4249b33f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506de698-c29c-4db5-8439-6caea2de63e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:28 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Volume e3bd1df8-f957-4e16-bc80-dab9ba595b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18', 'volume_size': 1} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302498070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bd1df8-f957-4e16-bc80-dab9ba595b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:29Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Creating volume e3bd1df8-f957-4e16-bc80-dab9ba595b18 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:07:28 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:07:28 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:28 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 1073741824 Sep 09 18:07:28 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:29 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 1073741824" returned: 0 in 0.431s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=118,cinder:INSERT=39,cinder:UPDATE=170,cinder:DELETE=13 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:29 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 Sep 09 18:07:29 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:29 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506de698-c29c-4db5-8439-6caea2de63e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2d22a2-640d-47c0-9cd6-a3c684f3d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:29 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Volume volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 (e3bd1df8-f957-4e16-bc80-dab9ba595b18): created successfully Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2d22a2-640d-47c0-9cd6-a3c684f3d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (aacca9ec-dcca-4ddc-b61e-47364c0c6887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:29 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6072573e-c43b-488e-923e-f138fffb5f56 tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Creating offline snapshot 4b4869e4-9e7d-4d02-a176-3bf62f943556 of volume e3bd1df8-f957-4e16-bc80-dab9ba595b18 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd614b97-6afb-44da-973a-90d72ad577f0]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:29 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:29 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 Sep 09 18:07:29 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:30 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18" returned: 0 in 0.377s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:30 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 1G Sep 09 18:07:30 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:30 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 1G" returned: 0 in 0.401s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:30 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 Sep 09 18:07:30 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:30 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556" returned: 0 in 0.298s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:30 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 is being set with open permissions: ugo+rw Sep 09 18:07:30 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:30 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 Sep 09 18:07:30 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:31 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556" returned: 0 in 0.251s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=142,cinder:INSERT=50,cinder:UPDATE=163,cinder:DELETE=15 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:31 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.info Sep 09 18:07:31 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:31 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.info" returned: 0 in 0.271s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:31 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.info is being set with open permissions: ugo+rw Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:31 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.info Sep 09 18:07:31 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:31 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.info" returned: 0 in 0.259s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:31 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-e7d16b44-add8-4963-8001-aae5fe436eae tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-4b4869e4-9e7d-4d02-a176-3bf62f943556-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Lock "cinder-4b4869e4-9e7d-4d02-a176-3bf62f943556-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:31 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-e3bd1df8-f957-4e16-bc80-dab9ba595b18" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-e3bd1df8-f957-4e16-bc80-dab9ba595b18" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-4b4869e4-9e7d-4d02-a176-3bf62f943556" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-4b4869e4-9e7d-4d02-a176-3bf62f943556" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot 4b4869e4-9e7d-4d02-a176-3bf62f943556 of volume e3bd1df8-f957-4e16-bc80-dab9ba595b18 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3b0749-009a-46d1-8421-14b7686ef73b]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:32 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 Sep 09 18:07:32 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:32 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598ffe8-0c0e-4cfb-be52-dab3e0d0b724]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:32 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 Sep 09 18:07:32 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:32 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18" returned: 0 in 0.367s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:32 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 Sep 09 18:07:32 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:33 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556" returned: 0 in 0.315s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:33 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556 Sep 09 18:07:33 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:33 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18.4b4869e4-9e7d-4d02-a176-3bf62f943556" returned: 0 in 0.230s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-4b4869e4-9e7d-4d02-a176-3bf62f943556" released by "_delete_snapshot" :: held 1.366s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-e3bd1df8-f957-4e16-bc80-dab9ba595b18" released by "delete_snapshot" :: held 1.388s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:33 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Created reservations ['1cef2c77-57c3-4ac0-8496-5f573ad62206', '3de89676-22ef-4115-9814-55a606e5b0a0', 'a5df0fee-0d08-4a70-a39d-166cd42ce244', 'f0da7628-282a-47ca-87c6-9b2285d136ce'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:07:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ba027fe5-8552-43ef-be5a-ee7139fab3a5 tempest-ProjectMemberTests-805547256 None] Lock "cinder-4b4869e4-9e7d-4d02-a176-3bf62f943556-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-e3bd1df8-f957-4e16-bc80-dab9ba595b18-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Lock "cinder-e3bd1df8-f957-4e16-bc80-dab9ba595b18-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-e3bd1df8-f957-4e16-bc80-dab9ba595b18" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-e3bd1df8-f957-4e16-bc80-dab9ba595b18" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3875641-92a0-4d2d-bd24-932a89d68422]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:34 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 Sep 09 18:07:34 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:34 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:34 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18 Sep 09 18:07:34 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:34 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-e3bd1df8-f957-4e16-bc80-dab9ba595b18" returned: 0 in 0.250s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-e3bd1df8-f957-4e16-bc80-dab9ba595b18" released by "delete_volume" :: held 0.670s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Created reservations ['f0c764d2-1a45-4e1f-b49c-a32e216a0348', '01d93753-10e1-4974-a074-479458048e84', '34313946-20ed-4eb0-beb7-95132f856acb', '89705ccd-7010-47f9-87dc-ed028f4cd546'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:34 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:34 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:35 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:35 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-f2e3f87d-e054-471e-b644-afe67217efa3 tempest-ProjectMemberTests-805547256 None] Lock "cinder-e3bd1df8-f957-4e16-bc80-dab9ba595b18-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (9461bf71-118e-485e-9a36-9052fcd3b602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1caf8cb6-1a45-4ace-81bc-56a165397791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1caf8cb6-1a45-4ace-81bc-56a165397791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379703488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fdbad2-ab69-4d8a-aa9b-14efa351f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:36Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39109ca-4c80-4d45-81be-5995ac15ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39109ca-4c80-4d45-81be-5995ac15ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e796a0d-22b5-41cf-b721-04ad4ad5437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e796a0d-22b5-41cf-b721-04ad4ad5437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58fdbad2-ab69-4d8a-aa9b-14efa351f554', 'volume_name': 'volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2196cc19-41c1-47e4-9298-2a974f498875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2196cc19-41c1-47e4-9298-2a974f498875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebefb147-025f-4f0e-9560-2a6c91c6125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:35 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Volume 58fdbad2-ab69-4d8a-aa9b-14efa351f554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554', 'volume_size': 1} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1379703488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58fdbad2-ab69-4d8a-aa9b-14efa351f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:36Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Creating volume 58fdbad2-ab69-4d8a-aa9b-14efa351f554 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:07:35 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:07:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:35 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 1073741824 Sep 09 18:07:35 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:36 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 1073741824" returned: 0 in 0.411s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:36 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 Sep 09 18:07:36 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:36 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554" returned: 0 in 0.238s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebefb147-025f-4f0e-9560-2a6c91c6125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18520408-8a84-469f-8c36-59d9bfee7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:36 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Volume volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 (58fdbad2-ab69-4d8a-aa9b-14efa351f554): created successfully Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18520408-8a84-469f-8c36-59d9bfee7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (9461bf71-118e-485e-9a36-9052fcd3b602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:36 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-685b0aed-0b76-46af-ad0f-c854f184f8d7 tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Creating offline snapshot b907512b-5484-43b5-bb23-e96288d1d20d of volume 58fdbad2-ab69-4d8a-aa9b-14efa351f554 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[434bc8d6-16b4-4150-88ee-f31bdaa1435a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:37 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 Sep 09 18:07:37 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:37 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554" returned: 0 in 0.385s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:37 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d 1G Sep 09 18:07:37 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:37 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d 1G" returned: 0 in 0.392s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:37 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d Sep 09 18:07:37 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:37 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d" returned: 0 in 0.301s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:37 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d is being set with open permissions: ugo+rw Sep 09 18:07:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:37 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d Sep 09 18:07:37 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:38 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d" returned: 0 in 0.255s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:38 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.info Sep 09 18:07:38 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:38 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.info" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:38 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.info is being set with open permissions: ugo+rw Sep 09 18:07:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:38 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.info Sep 09 18:07:38 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:38 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.info" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-82c70373-d43a-4099-a0a1-963451101064 tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-b907512b-5484-43b5-bb23-e96288d1d20d-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Lock "cinder-b907512b-5484-43b5-bb23-e96288d1d20d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-58fdbad2-ab69-4d8a-aa9b-14efa351f554" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-58fdbad2-ab69-4d8a-aa9b-14efa351f554" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-b907512b-5484-43b5-bb23-e96288d1d20d" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-b907512b-5484-43b5-bb23-e96288d1d20d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot b907512b-5484-43b5-bb23-e96288d1d20d of volume 58fdbad2-ab69-4d8a-aa9b-14efa351f554 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ead14-2ae4-415b-848e-0a34f39a3fe3]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:39 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d Sep 09 18:07:39 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:39 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d" returned: 0 in 0.347s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed6d755-13bb-40db-9018-c13e0f3b201d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:39 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 Sep 09 18:07:39 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:39 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554" returned: 0 in 0.351s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:39 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d Sep 09 18:07:39 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:40 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d" returned: 0 in 0.335s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:40 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d Sep 09 18:07:40 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:40 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554.b907512b-5484-43b5-bb23-e96288d1d20d" returned: 0 in 0.233s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-b907512b-5484-43b5-bb23-e96288d1d20d" released by "_delete_snapshot" :: held 1.354s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-58fdbad2-ab69-4d8a-aa9b-14efa351f554" released by "delete_snapshot" :: held 1.376s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:40 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Created reservations ['dbccbc0b-1dc9-47ce-8f8d-2bb96fbf8fec', '01b27575-d3aa-4254-8141-2b58ffbc526b', '55475bbf-cf11-4d2c-a312-4979ed785c7e', 'cc6b1150-5661-4394-b60e-d78791e14190'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:40 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:07:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-6ea0a6e4-5fdc-4064-b9e2-39f93d23f22f tempest-ProjectMemberTests-805547256 None] Lock "cinder-b907512b-5484-43b5-bb23-e96288d1d20d-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-58fdbad2-ab69-4d8a-aa9b-14efa351f554-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Lock "cinder-58fdbad2-ab69-4d8a-aa9b-14efa351f554-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-58fdbad2-ab69-4d8a-aa9b-14efa351f554" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-58fdbad2-ab69-4d8a-aa9b-14efa351f554" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2878339-23ab-423a-883f-ea2dd1578ebd]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:41 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 Sep 09 18:07:41 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:41 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:41 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554 Sep 09 18:07:41 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:41 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-58fdbad2-ab69-4d8a-aa9b-14efa351f554" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-58fdbad2-ab69-4d8a-aa9b-14efa351f554" released by "delete_volume" :: held 0.644s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Created reservations ['64d1b3d2-042c-4638-8db4-f72a46469352', 'a10b7e6d-f942-477d-bd67-d221b02c8389', '10aa0378-2e59-46d8-a799-c00d47228f64', 'e29837c9-8a71-4252-8a33-d8b4232630cd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:41 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:41 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:42 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.254s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:42 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-04a17cdb-16db-4628-892a-cf9b3ddf53c9 tempest-ProjectMemberTests-805547256 None] Lock "cinder-58fdbad2-ab69-4d8a-aa9b-14efa351f554-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (6f41678d-6010-416a-b66d-7e1b2660bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43546266-1c58-42dd-91e5-c18cc3d8a701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43546266-1c58-42dd-91e5-c18cc3d8a701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1299339313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71efed49-b68e-40c4-9de2-61275e8849eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:43Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27c0fd0-6a7b-4124-af4f-9901206545ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27c0fd0-6a7b-4124-af4f-9901206545ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0d8bbc-791e-4adc-8f24-f4ac2642609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0d8bbc-791e-4adc-8f24-f4ac2642609c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71efed49-b68e-40c4-9de2-61275e8849eb', 'volume_name': 'volume-71efed49-b68e-40c4-9de2-61275e8849eb', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99916c5-147c-4caa-9bc0-ac9e4166947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99916c5-147c-4caa-9bc0-ac9e4166947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae1701f-c698-4954-be58-c24f5b2ba004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:42 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Volume 71efed49-b68e-40c4-9de2-61275e8849eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71efed49-b68e-40c4-9de2-61275e8849eb', 'volume_size': 1} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1299339313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71efed49-b68e-40c4-9de2-61275e8849eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d229c5cfdb47788c9148e0b72bed5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:43Z,use_quota=True,user_id='5a61c99bde5f4af8b6f0533eb5a44627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Creating volume 71efed49-b68e-40c4-9de2-61275e8849eb {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:07:42 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:07:42 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:42 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb 1073741824 Sep 09 18:07:42 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:43 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb 1073741824" returned: 0 in 0.418s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:43 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb Sep 09 18:07:43 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:43 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb" returned: 0 in 0.238s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae1701f-c698-4954-be58-c24f5b2ba004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71efed49-b68e-40c4-9de2-61275e8849eb', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee866dd-25e7-4876-869e-9e0b62a91283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:43 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Volume volume-71efed49-b68e-40c4-9de2-61275e8849eb (71efed49-b68e-40c4-9de2-61275e8849eb): created successfully Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee866dd-25e7-4876-869e-9e0b62a91283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Flow 'volume_create_manager' (6f41678d-6010-416a-b66d-7e1b2660bb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:43 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-547d933c-7a44-4df4-b66b-89c4fee345dd tempest-ProjectMemberTests-805547256 None] Created volume successfully. Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Creating offline snapshot 641062ff-546d-4501-806e-0e4fe15d99d8 of volume 71efed49-b68e-40c4-9de2-61275e8849eb {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a662f2c-0c21-40ba-b26e-dc5e13cab119]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:43 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:44 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb Sep 09 18:07:44 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:44 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb" returned: 0 in 0.350s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:44 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 1G Sep 09 18:07:44 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:44 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 1G" returned: 0 in 0.386s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71efed49-b68e-40c4-9de2-61275e8849eb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:44 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71efed49-b68e-40c4-9de2-61275e8849eb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 Sep 09 18:07:44 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:44 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71efed49-b68e-40c4-9de2-61275e8849eb -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8" returned: 0 in 0.293s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:44 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 is being set with open permissions: ugo+rw Sep 09 18:07:44 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:44 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 Sep 09 18:07:44 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:45 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8" returned: 0 in 0.238s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:45 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.info Sep 09 18:07:45 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:45 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.info" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:45 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.info is being set with open permissions: ugo+rw Sep 09 18:07:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:45 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.info Sep 09 18:07:45 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:45 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.info" returned: 0 in 0.232s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:45 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:45 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9bc4a21f-60bd-43d1-805c-88bc08fa141e tempest-ProjectMemberTests-805547256 None] Create snapshot completed successfully Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-641062ff-546d-4501-806e-0e4fe15d99d8-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Lock "cinder-641062ff-546d-4501-806e-0e4fe15d99d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-71efed49-b68e-40c4-9de2-61275e8849eb" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-71efed49-b68e-40c4-9de2-61275e8849eb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-641062ff-546d-4501-806e-0e4fe15d99d8" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-641062ff-546d-4501-806e-0e4fe15d99d8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Deleting offline snapshot 641062ff-546d-4501-806e-0e4fe15d99d8 of volume 71efed49-b68e-40c4-9de2-61275e8849eb {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] snapshot_file for this snap is: volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b8c6dc-6ece-4f0b-909a-6e8e06653f15]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:46 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 Sep 09 18:07:46 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:46 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8" returned: 0 in 0.346s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71efed49-b68e-40c4-9de2-61275e8849eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9da8628-7e48-444b-9471-265aae4db923]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:46 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb Sep 09 18:07:46 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:46 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb" returned: 0 in 0.341s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:46 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:46 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 Sep 09 18:07:46 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:47 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8" returned: 0 in 0.312s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:47 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8 Sep 09 18:07:47 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:47 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:47 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb.641062ff-546d-4501-806e-0e4fe15d99d8" returned: 0 in 0.228s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-641062ff-546d-4501-806e-0e4fe15d99d8" released by "_delete_snapshot" :: held 1.313s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-71efed49-b68e-40c4-9de2-61275e8849eb" released by "delete_snapshot" :: held 1.333s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:47 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Created reservations ['09a858b8-f9bf-432c-8869-4074f620827f', 'db91bff5-61f9-433b-a468-016f6ee458e9', '8003d3ea-1802-4a6b-a946-84f2bacad10d', '1e572cde-73e1-48bb-a6b5-072eb0faebda'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:47 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Delete snapshot completed successfully. Sep 09 18:07:47 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-00233902-3f3d-4a7d-9ff2-f54acec6ff4d tempest-ProjectMemberTests-805547256 None] Lock "cinder-641062ff-546d-4501-806e-0e4fe15d99d8-delete_snapshot" released by "delete_snapshot" :: held 1.469s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-71efed49-b68e-40c4-9de2-61275e8849eb-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Lock "cinder-71efed49-b68e-40c4-9de2-61275e8849eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Acquiring lock "cinder-quobyte-71efed49-b68e-40c4-9de2-61275e8849eb" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-71efed49-b68e-40c4-9de2-61275e8849eb" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[83da7cc7-e033-49cf-bbb2-47cc31647fd1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:48 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb Sep 09 18:07:48 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:48 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb" returned: 0 in 0.340s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:48 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb Sep 09 18:07:48 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:48 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-71efed49-b68e-40c4-9de2-61275e8849eb" returned: 0 in 0.239s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Lock "cinder-quobyte-71efed49-b68e-40c4-9de2-61275e8849eb" released by "delete_volume" :: held 0.639s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:48 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Created reservations ['f0ed1438-bb46-44e3-bd78-c70cc6ab0e25', 'b6de6f1f-9fd9-4d9e-b03a-70f74589dd32', 'cb173a9d-06e0-4856-ac14-56dd505f77e8', 'f135007f-5c36-4899-96d0-ce710a2e36e7'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:49 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:49 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:49 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.231s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:49 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Deleted volume successfully. Sep 09 18:07:49 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-5b99dcc4-3ec2-472a-b5d4-623ca25380bf tempest-ProjectMemberTests-805547256 None] Lock "cinder-71efed49-b68e-40c4-9de2-61275e8849eb-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (a2afcc7a-b937-43ec-9f16-7f32e4533dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d92428-07a0-4489-8f71-dd88ced5c138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d92428-07a0-4489-8f71-dd88ced5c138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914268770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4646bbd7-1727-4518-9e37-f0fdf5133e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:53Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9791f2f-085f-4f8d-b6fd-787e192dded8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9791f2f-085f-4f8d-b6fd-787e192dded8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca225c8-701d-4c12-b5fb-26d8f8a4d535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca225c8-701d-4c12-b5fb-26d8f8a4d535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4646bbd7-1727-4518-9e37-f0fdf5133e7e', 'volume_name': 'volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121bec99-0230-4178-9d18-78e31c88f52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121bec99-0230-4178-9d18-78e31c88f52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ac49c8-80cf-4e17-af20-4b94f14bdc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:52 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Volume 4646bbd7-1727-4518-9e37-f0fdf5133e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e', 'volume_size': 1} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914268770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4646bbd7-1727-4518-9e37-f0fdf5133e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:07:53Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Creating volume 4646bbd7-1727-4518-9e37-f0fdf5133e7e {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:07:52 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:07:52 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:52 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e 1073741824 Sep 09 18:07:52 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:53 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e 1073741824" returned: 0 in 0.389s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:53 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e Sep 09 18:07:53 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:53 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e" returned: 0 in 0.231s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ac49c8-80cf-4e17-af20-4b94f14bdc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc9b708-9501-46f8-8fa6-33f2c85dc961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:07:53 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Volume volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e (4646bbd7-1727-4518-9e37-f0fdf5133e7e): created successfully Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc9b708-9501-46f8-8fa6-33f2c85dc961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:07:53 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (a2afcc7a-b937-43ec-9f16-7f32e4533dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:07:53 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-32cb7f3b-aa13-4513-9b32-b45abfbdbaba tempest-ProjectReaderTests-1038151941 None] Created volume successfully. Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Creating offline snapshot 59554d13-cbf0-43f8-b409-31f4c6cb7a79 of volume 4646bbd7-1727-4518-9e37-f0fdf5133e7e {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61cad0b-f9a6-4faa-8265-087983f79c57]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:54 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e Sep 09 18:07:54 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:54 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e" returned: 0 in 0.348s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:54 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 1G Sep 09 18:07:54 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:54 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 1G" returned: 0 in 0.375s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:54 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:54 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 Sep 09 18:07:54 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:55 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79" returned: 0 in 0.286s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:55 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 is being set with open permissions: ugo+rw Sep 09 18:07:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:55 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 Sep 09 18:07:55 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:55 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79" returned: 0 in 0.234s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:55 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.info Sep 09 18:07:55 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:55 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.info" returned: 0 in 0.238s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:55 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.info is being set with open permissions: ugo+rw Sep 09 18:07:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:55 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.info Sep 09 18:07:55 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:55 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.info" returned: 0 in 0.231s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:55 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:55 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-59affd4c-dceb-477b-90b6-80a4e3d099ab tempest-ProjectReaderTests-1038151941 None] Create snapshot completed successfully Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-59554d13-cbf0-43f8-b409-31f4c6cb7a79-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-59554d13-cbf0-43f8-b409-31f4c6cb7a79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-4646bbd7-1727-4518-9e37-f0fdf5133e7e" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-4646bbd7-1727-4518-9e37-f0fdf5133e7e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-59554d13-cbf0-43f8-b409-31f4c6cb7a79" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-59554d13-cbf0-43f8-b409-31f4c6cb7a79" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Deleting offline snapshot 59554d13-cbf0-43f8-b409-31f4c6cb7a79 of volume 4646bbd7-1727-4518-9e37-f0fdf5133e7e {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] snapshot_file for this snap is: volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[28238ce5-0176-44e4-9ef7-17eabdc280fa]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:56 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 Sep 09 18:07:56 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:56 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79" returned: 0 in 0.344s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d45f9e-7f54-4c64-92db-c448a623f8a4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:56 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:56 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e Sep 09 18:07:56 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:57 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e" returned: 0 in 0.362s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:57 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 Sep 09 18:07:57 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:57 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79" returned: 0 in 0.307s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:57 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79 Sep 09 18:07:57 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:57 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e.59554d13-cbf0-43f8-b409-31f4c6cb7a79" returned: 0 in 0.226s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-59554d13-cbf0-43f8-b409-31f4c6cb7a79" released by "_delete_snapshot" :: held 1.325s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-4646bbd7-1727-4518-9e37-f0fdf5133e7e" released by "delete_snapshot" :: held 1.347s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Created reservations ['21d940d5-01be-43cf-b451-2fe073b882a9', '25fb5ae3-1024-4d25-9c5a-9e28c4467f16', '8b722285-637b-46b0-9eda-6199181d028f', 'c4dc5292-21ff-406d-b57d-c830804c62dd'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:57 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Delete snapshot completed successfully. Sep 09 18:07:57 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-03e364ac-a71e-4109-b62b-95e8f8f0b9d4 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-59554d13-cbf0-43f8-b409-31f4c6cb7a79-delete_snapshot" released by "delete_snapshot" :: held 1.469s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-4646bbd7-1727-4518-9e37-f0fdf5133e7e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-4646bbd7-1727-4518-9e37-f0fdf5133e7e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-4646bbd7-1727-4518-9e37-f0fdf5133e7e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:07:58 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-4646bbd7-1727-4518-9e37-f0fdf5133e7e" acquired by "delete_volume" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:07:58 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edd0e6c-371c-444d-be11-73391145a6dc]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:07:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:58 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e Sep 09 18:07:58 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:58 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e" returned: 0 in 0.348s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:58 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:58 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e Sep 09 18:07:58 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:59 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4646bbd7-1727-4518-9e37-f0fdf5133e7e" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-4646bbd7-1727-4518-9e37-f0fdf5133e7e" released by "delete_volume" :: held 0.652s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Created reservations ['0fc9a659-4dcc-42a9-9abb-063992fb72f9', 'a3a05279-a835-4030-b580-7e3f9d9cbf1a', '0f9f79f3-177f-4f95-b27e-15e6b20c067a', 'e53b9a0e-2781-4e5b-9ae2-258acdd37ff1'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:59 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:07:59 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:59 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.260s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:59 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Deleted volume successfully. Sep 09 18:07:59 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-1a498e15-a6b0-46e8-b080-1fd2c407f361 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-4646bbd7-1727-4518-9e37-f0fdf5133e7e-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (076615a8-0609-4338-9941-ef0ae0097e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2be053-7d68-4c47-ae89-94ec49e56b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2be053-7d68-4c47-ae89-94ec49e56b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128084738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faffe54-e0e9-47e3-ad6f-818b8e8f56ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:00Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3639bb6c-9d3f-4c36-a5ed-27ecc18b46be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3639bb6c-9d3f-4c36-a5ed-27ecc18b46be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9eae48-2059-4214-97d4-c17dc33204a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9eae48-2059-4214-97d4-c17dc33204a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4faffe54-e0e9-47e3-ad6f-818b8e8f56ae', 'volume_name': 'volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4764c378-50ff-488a-98d8-2f723331ef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4764c378-50ff-488a-98d8-2f723331ef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed74fd5-21c1-422c-a1c9-6360540c5ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Volume 4faffe54-e0e9-47e3-ad6f-818b8e8f56ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae', 'volume_size': 1} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128084738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faffe54-e0e9-47e3-ad6f-818b8e8f56ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:00Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Creating volume 4faffe54-e0e9-47e3-ad6f-818b8e8f56ae {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:08:00 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:00 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae 1073741824 Sep 09 18:08:00 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:00 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae 1073741824" returned: 0 in 0.403s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:00 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae Sep 09 18:08:00 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:00 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" returned: 0 in 0.262s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed74fd5-21c1-422c-a1c9-6360540c5ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0169de2-63c2-49f2-9dfc-3170d41c4f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:00 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Volume volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae (4faffe54-e0e9-47e3-ad6f-818b8e8f56ae): created successfully Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0169de2-63c2-49f2-9dfc-3170d41c4f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:00 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (076615a8-0609-4338-9941-ef0ae0097e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:00 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-af99310e-60b9-4cf1-87a0-f2bd9dfa2622 tempest-ProjectReaderTests-1038151941 None] Created volume successfully. Sep 09 18:08:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:01 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Creating offline snapshot dbc6293a-4801-414d-bb71-a482d1e7149d of volume 4faffe54-e0e9-47e3-ad6f-818b8e8f56ae {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:08:01 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1553a3c-514d-4b65-b7a8-f7669fedfdd1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:01 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae Sep 09 18:08:01 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:01 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:01 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:01 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d 1G Sep 09 18:08:01 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:02 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d 1G" returned: 0 in 0.382s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:02 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d Sep 09 18:08:02 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:02 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d" returned: 0 in 0.292s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:02 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d is being set with open permissions: ugo+rw Sep 09 18:08:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:02 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d Sep 09 18:08:02 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:02 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:02 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.info Sep 09 18:08:02 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:02 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.info" returned: 0 in 0.263s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:02 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.info is being set with open permissions: ugo+rw Sep 09 18:08:02 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:02 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.info Sep 09 18:08:02 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:03 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.info" returned: 0 in 0.248s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:03 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0beea198-95f8-45c1-89f9-596f4a8ebb9f tempest-ProjectReaderTests-1038151941 None] Create snapshot completed successfully Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-dbc6293a-4801-414d-bb71-a482d1e7149d-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-dbc6293a-4801-414d-bb71-a482d1e7149d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-dbc6293a-4801-414d-bb71-a482d1e7149d" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-dbc6293a-4801-414d-bb71-a482d1e7149d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Deleting offline snapshot dbc6293a-4801-414d-bb71-a482d1e7149d of volume 4faffe54-e0e9-47e3-ad6f-818b8e8f56ae {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] snapshot_file for this snap is: volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af37dda-3b3f-4701-907d-028077de1257]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:03 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d Sep 09 18:08:03 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:03 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d" returned: 0 in 0.344s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[03de210c-7484-4778-b0fb-8564e1d7cd64]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:03 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:03 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae Sep 09 18:08:03 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:04 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" returned: 0 in 0.347s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:04 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d Sep 09 18:08:04 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:04 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d" returned: 0 in 0.328s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:04 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d Sep 09 18:08:04 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:04 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae.dbc6293a-4801-414d-bb71-a482d1e7149d" returned: 0 in 0.239s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-dbc6293a-4801-414d-bb71-a482d1e7149d" released by "_delete_snapshot" :: held 1.345s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" released by "delete_snapshot" :: held 1.366s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Created reservations ['b18b6b90-7759-4243-bc79-395b3aaa0d5d', '148c1ee8-28ef-4a5b-a8c6-95dcbbe62d91', '321ee700-e8c7-4d5d-9f8d-975e21a99c31', 'cd0d85b0-e9c8-4693-bfb0-2c76c01e8dd8'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:04 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Delete snapshot completed successfully. Sep 09 18:08:04 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-24f13d00-0f25-453e-9d20-7996bd3ab534 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-dbc6293a-4801-414d-bb71-a482d1e7149d-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:05 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:05 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:05 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.234s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo_service.periodic_task [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] Running periodic task VolumeManager._thread_info {{(pid=87202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread count: 28 {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-977e3826-edec-4e3b-adf8-9da3f0e93a1b None None] thread info: [<_MainThread(MainThread, started 128411255885952)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Lock "cinder-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f532dd7-70b5-4943-89dd-a467cf536dee]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:05 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:05 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae Sep 09 18:08:05 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:06 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" returned: 0 in 0.368s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:06 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae Sep 09 18:08:06 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:06 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" returned: 0 in 0.249s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae" released by "delete_volume" :: held 0.671s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Created reservations ['e566b56b-bcca-48c3-a558-7f97f38e3c7a', 'bdf76b25-42a2-44d3-a7e4-e65fc4f09d9a', '15f6e4e7-d573-4b6c-a15b-6d06c10808e1', 'e1521a9e-1b5f-4d95-b99a-cd08124ecdad'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:06 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:06 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:06 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.253s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:06 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Deleted volume successfully. Sep 09 18:08:06 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-4751b620-76e5-45a7-a4d0-00e3cbfb52cb tempest-ProjectReaderTests-1038151941 None] Lock "cinder-4faffe54-e0e9-47e3-ad6f-818b8e8f56ae-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (eb1fd1aa-fc88-429f-bac6-1365ef422392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c2b92b-5358-4649-b803-38d11f5fbbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c2b92b-5358-4649-b803-38d11f5fbbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677855163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca630ef8-4bab-4be2-a687-253722867a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:07Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9252d5-1cb7-40cc-84e8-355de322b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9252d5-1cb7-40cc-84e8-355de322b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c00a949-2d2f-4cef-bcf0-942b3b74857f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c00a949-2d2f-4cef-bcf0-942b3b74857f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca630ef8-4bab-4be2-a687-253722867a70', 'volume_name': 'volume-ca630ef8-4bab-4be2-a687-253722867a70', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141a951f-777f-4f08-bd50-bde2bea7ead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141a951f-777f-4f08-bd50-bde2bea7ead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1fd7ac-8e43-42ee-b399-acca4076e72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:07 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Volume ca630ef8-4bab-4be2-a687-253722867a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca630ef8-4bab-4be2-a687-253722867a70', 'volume_size': 1} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677855163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca630ef8-4bab-4be2-a687-253722867a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:07Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Creating volume ca630ef8-4bab-4be2-a687-253722867a70 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:08:07 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:07 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 1073741824 Sep 09 18:08:07 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:07 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 1073741824" returned: 0 in 0.395s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:07 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 Sep 09 18:08:07 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:07 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70" returned: 0 in 0.244s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1fd7ac-8e43-42ee-b399-acca4076e72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca630ef8-4bab-4be2-a687-253722867a70', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ec666e-f5b7-4cc4-8c33-28f5bde981ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:07 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Volume volume-ca630ef8-4bab-4be2-a687-253722867a70 (ca630ef8-4bab-4be2-a687-253722867a70): created successfully Sep 09 18:08:07 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ec666e-f5b7-4cc4-8c33-28f5bde981ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:08 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (eb1fd1aa-fc88-429f-bac6-1365ef422392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:08 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-98a23d10-640f-4820-80c2-9ef059ade295 tempest-ProjectReaderTests-1038151941 None] Created volume successfully. Sep 09 18:08:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:08 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Creating offline snapshot 6bb444dc-fd75-4f99-af84-4cb32e92a873 of volume ca630ef8-4bab-4be2-a687-253722867a70 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:08:08 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[554ed573-2c94-4c1d-9eaf-8f2fa29d20c5]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:08 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 Sep 09 18:08:08 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:08 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70" returned: 0 in 0.335s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:08 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:08 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 1G Sep 09 18:08:08 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:09 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 1G" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca630ef8-4bab-4be2-a687-253722867a70 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:09 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca630ef8-4bab-4be2-a687-253722867a70 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 Sep 09 18:08:09 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:09 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca630ef8-4bab-4be2-a687-253722867a70 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873" returned: 0 in 0.280s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:09 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 is being set with open permissions: ugo+rw Sep 09 18:08:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:09 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 Sep 09 18:08:09 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:09 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873" returned: 0 in 0.240s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:09 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.info Sep 09 18:08:09 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:09 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.info" returned: 0 in 0.245s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:09 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.info is being set with open permissions: ugo+rw Sep 09 18:08:09 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:09 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.info Sep 09 18:08:09 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:10 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.info" returned: 0 in 0.230s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.783s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:10 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-fe1eb6c9-1f25-46a7-b62b-26df65139431 tempest-ProjectReaderTests-1038151941 None] Create snapshot completed successfully Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-6bb444dc-fd75-4f99-af84-4cb32e92a873-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Lock "cinder-6bb444dc-fd75-4f99-af84-4cb32e92a873-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-ca630ef8-4bab-4be2-a687-253722867a70" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-ca630ef8-4bab-4be2-a687-253722867a70" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-6bb444dc-fd75-4f99-af84-4cb32e92a873" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-6bb444dc-fd75-4f99-af84-4cb32e92a873" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Deleting offline snapshot 6bb444dc-fd75-4f99-af84-4cb32e92a873 of volume ca630ef8-4bab-4be2-a687-253722867a70 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] snapshot_file for this snap is: volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[285931f3-d525-450f-8315-fc9045a57407]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:10 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 Sep 09 18:08:10 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:10 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873" returned: 0 in 0.344s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca630ef8-4bab-4be2-a687-253722867a70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eab96ab-0d50-4da2-a4d8-b1ba211ff4b4]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:10 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:11 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 Sep 09 18:08:11 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:11 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70" returned: 0 in 0.346s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:11 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 Sep 09 18:08:11 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:11 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873" returned: 0 in 0.319s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:11 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873 Sep 09 18:08:11 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:11 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70.6bb444dc-fd75-4f99-af84-4cb32e92a873" returned: 0 in 0.260s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-6bb444dc-fd75-4f99-af84-4cb32e92a873" released by "_delete_snapshot" :: held 1.355s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-ca630ef8-4bab-4be2-a687-253722867a70" released by "delete_snapshot" :: held 1.378s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Created reservations ['348ccb51-5cd1-4af9-ab99-2a7daffda906', '6e356dc3-9f96-4838-bc25-47d0f76eb1ca', 'b3c27ff3-b08f-4d2f-8a26-b34dd487a15c', 'd9e3bce4-aa49-4ae1-872e-eddabcf5792c'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:11 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Delete snapshot completed successfully. Sep 09 18:08:11 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-bb0fe845-3735-4049-b573-1c9b864a038c tempest-ProjectReaderTests-1038151941 None] Lock "cinder-6bb444dc-fd75-4f99-af84-4cb32e92a873-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-ca630ef8-4bab-4be2-a687-253722867a70-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-ca630ef8-4bab-4be2-a687-253722867a70-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-ca630ef8-4bab-4be2-a687-253722867a70" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:12 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-ca630ef8-4bab-4be2-a687-253722867a70" acquired by "delete_volume" :: waited 0.013s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:12 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b2bd42-0d98-4c25-aac9-a4825e1b562d]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:12 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:12 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 Sep 09 18:08:12 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:13 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70" returned: 0 in 0.347s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:13 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70 Sep 09 18:08:13 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:13 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ca630ef8-4bab-4be2-a687-253722867a70" returned: 0 in 0.230s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-ca630ef8-4bab-4be2-a687-253722867a70" released by "delete_volume" :: held 0.634s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Created reservations ['3003c26b-b1dd-4b1b-aea6-18aad51ef26a', 'cd2c73b0-4877-47f2-b817-99aacce776fa', 'de6d9fcf-1def-44c1-b41e-15b1d55e3d10', 'f0270d67-1ee7-4ce0-87ad-db83c6a53f65'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:13 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:13 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:13 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:13 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Deleted volume successfully. Sep 09 18:08:13 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-413fde5d-6ecf-458c-9ce5-0f465539ff82 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-ca630ef8-4bab-4be2-a687-253722867a70-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (1b5d98bf-71af-4aab-83eb-915796763e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77603cd-666f-4e18-ba79-1bc21db84789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77603cd-666f-4e18-ba79-1bc21db84789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862910123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d7041f-c459-42cd-918b-6f3d0d82d620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:14Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8077542-9dac-4718-a1ff-3b84bcde4aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8077542-9dac-4718-a1ff-3b84bcde4aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b788957-a452-4d62-a075-1db35728638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b788957-a452-4d62-a075-1db35728638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d7041f-c459-42cd-918b-6f3d0d82d620', 'volume_name': 'volume-96d7041f-c459-42cd-918b-6f3d0d82d620', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c094050c-0c06-4259-bebf-96b0b58a087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c094050c-0c06-4259-bebf-96b0b58a087d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8447efa-d057-4159-a56a-1c2bd9e0c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Volume 96d7041f-c459-42cd-918b-6f3d0d82d620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d7041f-c459-42cd-918b-6f3d0d82d620', 'volume_size': 1} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862910123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d7041f-c459-42cd-918b-6f3d0d82d620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:14Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Creating volume 96d7041f-c459-42cd-918b-6f3d0d82d620 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:08:14 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:14 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 1073741824 Sep 09 18:08:14 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:14 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 1073741824" returned: 0 in 0.390s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:14 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 Sep 09 18:08:14 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:14 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620" returned: 0 in 0.240s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8447efa-d057-4159-a56a-1c2bd9e0c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d7041f-c459-42cd-918b-6f3d0d82d620', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:14 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2445f7c9-22bd-4a0a-9f12-2a007474256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:14 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Volume volume-96d7041f-c459-42cd-918b-6f3d0d82d620 (96d7041f-c459-42cd-918b-6f3d0d82d620): created successfully Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2445f7c9-22bd-4a0a-9f12-2a007474256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (1b5d98bf-71af-4aab-83eb-915796763e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:15 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-0a3d2ac4-271b-43a9-a6c1-7a039da30ad5 tempest-ProjectReaderTests-1038151941 None] Created volume successfully. Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Creating offline snapshot 7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 of volume 96d7041f-c459-42cd-918b-6f3d0d82d620 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca17eb2-be74-4298-a480-634990a8ee66]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:15 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 Sep 09 18:08:15 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:15 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620" returned: 0 in 0.334s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:15 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:15 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 1G Sep 09 18:08:15 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:16 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 1G" returned: 0 in 0.378s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d7041f-c459-42cd-918b-6f3d0d82d620 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:16 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d7041f-c459-42cd-918b-6f3d0d82d620 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 Sep 09 18:08:16 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:16 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96d7041f-c459-42cd-918b-6f3d0d82d620 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3" returned: 0 in 0.290s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:16 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 is being set with open permissions: ugo+rw Sep 09 18:08:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:16 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 Sep 09 18:08:16 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:16 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3" returned: 0 in 0.234s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:16 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.info Sep 09 18:08:16 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:16 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.info" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:16 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.info is being set with open permissions: ugo+rw Sep 09 18:08:16 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:16 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.info Sep 09 18:08:16 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:17 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.info" returned: 0 in 0.229s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:17 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-fe8f734c-ea5a-42a0-aab8-7522643adf37 tempest-ProjectReaderTests-1038151941 None] Create snapshot completed successfully Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-96d7041f-c459-42cd-918b-6f3d0d82d620" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-96d7041f-c459-42cd-918b-6f3d0d82d620" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Deleting offline snapshot 7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 of volume 96d7041f-c459-42cd-918b-6f3d0d82d620 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] snapshot_file for this snap is: volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4a589-9396-4bbe-ae75-20435194e9b7]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:17 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 Sep 09 18:08:17 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:17 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3" returned: 0 in 0.352s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96d7041f-c459-42cd-918b-6f3d0d82d620(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4e4b61-347d-4cb1-a2e1-de43c5fca8fc]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:17 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:18 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 Sep 09 18:08:18 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:18 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:18 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 Sep 09 18:08:18 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:18 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3" returned: 0 in 0.326s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:18 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3 Sep 09 18:08:18 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:18 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620.7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3" returned: 0 in 0.237s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3" released by "_delete_snapshot" :: held 1.335s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-96d7041f-c459-42cd-918b-6f3d0d82d620" released by "delete_snapshot" :: held 1.355s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Created reservations ['d269ee38-0bc8-4d62-9e47-72a295a643fe', 'e9248a6f-4eb7-4ae3-b9e6-4bb3ea4d9a96', 'fc32cd33-8cf1-4814-8cdf-b7e78fb1bc38', 'b5698c29-90a1-42fa-b748-f52b20a45f0f'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:18 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Delete snapshot completed successfully. Sep 09 18:08:18 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-351e3c88-cd3a-4fed-bf4f-01ba6ad40d12 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-7ae2a8cb-5c34-4f29-9e8b-fad0a7d1aae3-delete_snapshot" released by "delete_snapshot" :: held 1.483s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-96d7041f-c459-42cd-918b-6f3d0d82d620-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-96d7041f-c459-42cd-918b-6f3d0d82d620-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-96d7041f-c459-42cd-918b-6f3d0d82d620" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:19 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-96d7041f-c459-42cd-918b-6f3d0d82d620" acquired by "delete_volume" :: waited 0.012s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:19 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[49051b69-a513-4400-88bc-64dfaaa149dc]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:19 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:19 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 Sep 09 18:08:19 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:20 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620" returned: 0 in 0.351s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:20 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620 Sep 09 18:08:20 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:20 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-96d7041f-c459-42cd-918b-6f3d0d82d620" returned: 0 in 0.232s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-96d7041f-c459-42cd-918b-6f3d0d82d620" released by "delete_volume" :: held 0.637s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Created reservations ['87e322ae-c98f-43ac-8e71-d13a5cc79488', '7df29871-f25c-4afb-8ae3-8d88833b3126', '670ed12c-a303-4b79-8c83-23ac662c18bd', '3b2736a8-aa5c-4ecc-80e5-bfc841a9eafe'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:20 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:20 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:20 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.244s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:20 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Deleted volume successfully. Sep 09 18:08:20 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-971d50ad-2f98-4816-9f6c-4d2aaa0fc588 tempest-ProjectReaderTests-1038151941 None] Lock "cinder-96d7041f-c459-42cd-918b-6f3d0d82d620-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (cd3827a0-7dc8-44c1-8926-fe2c702792ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d66f70e-cb79-451f-ad05-a19b83e64066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d66f70e-cb79-451f-ad05-a19b83e64066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850782732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:21Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4c9615-ab2b-477e-b011-934d3cf1cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4c9615-ab2b-477e-b011-934d3cf1cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc386d9-3fd9-4c48-a425-9b595f910da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc386d9-3fd9-4c48-a425-9b595f910da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5', 'volume_name': 'volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff4b226-e4fa-45b5-ac5e-0bf46a8133e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff4b226-e4fa-45b5-ac5e-0bf46a8133e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1298b443-8c6e-431e-954c-1f1b6bb4e310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:21 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Volume 1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5', 'volume_size': 1} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1850782732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5637a70e997f47b8a76a3027c778916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:21Z,use_quota=True,user_id='69acb96e15494e5fbf0cd52f9dc83701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Creating volume 1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:08:21 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:21 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 1073741824 Sep 09 18:08:21 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:21 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 1073741824" returned: 0 in 0.418s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:21 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:21 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 Sep 09 18:08:21 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:22 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" returned: 0 in 0.250s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1298b443-8c6e-431e-954c-1f1b6bb4e310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d58c6d4-1a83-4756-a96c-6e9ed5cb4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:22 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Volume volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 (1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5): created successfully Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d58c6d4-1a83-4756-a96c-6e9ed5cb4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Flow 'volume_create_manager' (cd3827a0-7dc8-44c1-8926-fe2c702792ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:22 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c61c9481-3a77-40fd-844a-705828bb04dc tempest-ProjectReaderTests-1038151941 None] Created volume successfully. Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Creating offline snapshot 683362a7-1cdc-40cf-916e-ece8013ca1f5 of volume 1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 {{(pid=87202) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[690dbcda-0288-40c9-9bf3-8ce6f3b5f323]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:22 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 Sep 09 18:08:22 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:22 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" returned: 0 in 0.352s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:22 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 1G {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:22 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 1G Sep 09 18:08:22 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:23 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 1G" returned: 0 in 0.401s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:23 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 Sep 09 18:08:23 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:23 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 -F qcow2 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5" returned: 0 in 0.286s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:23 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 is being set with open permissions: ugo+rw Sep 09 18:08:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:23 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 Sep 09 18:08:23 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:23 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:23 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:23 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.info Sep 09 18:08:23 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:24 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.info" returned: 0 in 0.247s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:24 devstack cinder-volume[87202]: WARNING cinder.volume.drivers.remotefs [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.info is being set with open permissions: ugo+rw Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.info {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:24 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.info Sep 09 18:08:24 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:24 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.info" returned: 0 in 0.233s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:24 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-c98931eb-1302-44b4-bc1b-964efccbfde2 tempest-ProjectReaderTests-1038151941 None] Create snapshot completed successfully Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-683362a7-1cdc-40cf-916e-ece8013ca1f5-delete_snapshot" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Lock "cinder-683362a7-1cdc-40cf-916e-ece8013ca1f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" by "delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-683362a7-1cdc-40cf-916e-ece8013ca1f5" by "_delete_snapshot" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-683362a7-1cdc-40cf-916e-ece8013ca1f5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Deleting offline snapshot 683362a7-1cdc-40cf-916e-ece8013ca1f5 of volume 1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] snapshot_file for this snap is: volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 {{(pid=87202) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[4735e5db-ed92-4446-acee-6f954cead5b1]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:24 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 Sep 09 18:08:24 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:24 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5" returned: 0 in 0.343s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87202) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f2da0-6c25-4051-8a6d-b5b63550f27a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:24 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:25 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 Sep 09 18:08:25 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:25 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" returned: 0 in 0.339s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:25 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 Sep 09 18:08:25 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:25 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5" returned: 0 in 0.318s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:25 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5 Sep 09 18:08:25 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:25 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:25 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5.683362a7-1cdc-40cf-916e-ece8013ca1f5" returned: 0 in 0.258s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-683362a7-1cdc-40cf-916e-ece8013ca1f5" released by "_delete_snapshot" :: held 1.347s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:25 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" released by "delete_snapshot" :: held 1.369s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:26 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Created reservations ['9efc0929-410a-4c0b-bac3-069419a0eef3', '46841f1a-499a-4894-a74d-1cef355a516e', 'ef509002-90a7-493e-a402-db6b016684b2', '5bce1343-c2bf-4edd-835e-713db1ac5278'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:26 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Delete snapshot completed successfully. Sep 09 18:08:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-9cdc6e96-d18a-44ee-93d2-d7d458f212da tempest-ProjectReaderTests-1038151941 None] Lock "cinder-683362a7-1cdc-40cf-916e-ece8013ca1f5-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Lock "cinder-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Acquiring lock "cinder-quobyte-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:26 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:26 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea25b888-6364-4b40-af41-6b86aa286599]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:26 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:26 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 Sep 09 18:08:26 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:27 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" returned: 0 in 0.363s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:27 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5 Sep 09 18:08:27 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:27 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" returned: 0 in 0.237s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Lock "cinder-quobyte-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5" released by "delete_volume" :: held 0.661s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Created reservations ['72697506-e622-4f8a-a7e4-e1534ee3b501', '6d4ace2a-581f-4a42-b68d-12b9d3c1cbe9', 'cacea45b-c663-4d93-b5bb-227f7eb9738d', '9ab8d7b0-0f5d-4821-8e49-2a29ffa85cde'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:27 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:27 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:27 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.244s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:27 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Deleted volume successfully. Sep 09 18:08:27 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-b5c1b4d1-1e91-423f-85cf-e051b89c436b tempest-ProjectReaderTests-1038151941 None] Lock "cinder-1f8c19ab-b467-4f0f-8e5b-f0cb850aaff5-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=106,cinder:INSERT=40,cinder:UPDATE=140,cinder:DELETE=8 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=143,cinder:SELECT=115,cinder:INSERT=39,cinder:DELETE=15 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Flow 'volume_create_manager' (65ec9b6c-f54d-4403-9d9e-271b593fd8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a581bca9-e6b0-4694-98e3-8fc164c9d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a581bca9-e6b0-4694-98e3-8fc164c9d45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874816665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996e50a1-36b7-4f0f-8764-5e5f7f115606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf65e02e6142495a9f0f9699b49d9c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:31Z,use_quota=True,user_id='055a5a92ced548b8b51475b1c33ee068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1c4688-96e6-4520-80af-dca23e0d734b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1c4688-96e6-4520-80af-dca23e0d734b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ab9811-cab4-4e5a-bc62-0821acd15ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ab9811-cab4-4e5a-bc62-0821acd15ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '996e50a1-36b7-4f0f-8764-5e5f7f115606', 'volume_name': 'volume-996e50a1-36b7-4f0f-8764-5e5f7f115606', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d46157-c9cb-4a20-9fe6-3876caffd56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d46157-c9cb-4a20-9fe6-3876caffd56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e8e611-372d-400e-b559-b02d6a98abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:31 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Volume 996e50a1-36b7-4f0f-8764-5e5f7f115606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-996e50a1-36b7-4f0f-8764-5e5f7f115606', 'volume_size': 1} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874816665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996e50a1-36b7-4f0f-8764-5e5f7f115606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf65e02e6142495a9f0f9699b49d9c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:31Z,use_quota=True,user_id='055a5a92ced548b8b51475b1c33ee068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Creating volume 996e50a1-36b7-4f0f-8764-5e5f7f115606 {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:08:31 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:31 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 1073741824 Sep 09 18:08:31 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:31 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 1073741824" returned: 0 in 0.392s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:31 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:31 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 Sep 09 18:08:31 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:32 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606" returned: 0 in 0.231s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e8e611-372d-400e-b559-b02d6a98abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-996e50a1-36b7-4f0f-8764-5e5f7f115606', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0cf359-2f03-486b-b578-1ccf8bc122f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:32 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Volume volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 (996e50a1-36b7-4f0f-8764-5e5f7f115606): created successfully Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0cf359-2f03-486b-b578-1ccf8bc122f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Flow 'volume_create_manager' (65ec9b6c-f54d-4403-9d9e-271b593fd8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:32 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-820497af-1ab5-455a-807b-b9caa4856b45 tempest-ProjectReaderTests-883343447 None] Created volume successfully. Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Acquiring lock "cinder-996e50a1-36b7-4f0f-8764-5e5f7f115606-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Lock "cinder-996e50a1-36b7-4f0f-8764-5e5f7f115606-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Acquiring lock "cinder-quobyte-996e50a1-36b7-4f0f-8764-5e5f7f115606" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Lock "cinder-quobyte-996e50a1-36b7-4f0f-8764-5e5f7f115606" acquired by "delete_volume" :: waited 0.016s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[273bf967-fb55-4c1b-97a0-326890aec42a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:32 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 Sep 09 18:08:32 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:32 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606" returned: 0 in 0.347s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:32 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:32 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606 Sep 09 18:08:32 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:33 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-996e50a1-36b7-4f0f-8764-5e5f7f115606" returned: 0 in 0.243s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Lock "cinder-quobyte-996e50a1-36b7-4f0f-8764-5e5f7f115606" released by "delete_volume" :: held 0.625s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Created reservations ['be7c26b5-1f3c-47e1-83c1-85379ddc1618', '379a9985-f07f-451e-8380-94331639a4dd', '550e963e-49cf-4df5-ba84-a1272454e138', 'b1fa86fd-1b9b-4445-b559-260478677c9c'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:33 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:33 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:33 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.237s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:33 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Deleted volume successfully. Sep 09 18:08:33 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-28919232-3e83-4f51-a5f1-be2c210166d5 tempest-ProjectReaderTests-883343447 None] Lock "cinder-996e50a1-36b7-4f0f-8764-5e5f7f115606-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Flow 'volume_create_manager' (ec344204-7eb8-48a9-b1a4-27c1afdb789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89361ada-3328-4004-8e62-eb37f8ae95df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89361ada-3328-4004-8e62-eb37f8ae95df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801943689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea993423-481f-4db4-a209-06aa2fe02bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf65e02e6142495a9f0f9699b49d9c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:34Z,use_quota=True,user_id='055a5a92ced548b8b51475b1c33ee068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdfae74-7bc0-420b-96f4-d5490ffc5300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdfae74-7bc0-420b-96f4-d5490ffc5300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b25dbff-de7a-43bf-8104-aea4502a972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b25dbff-de7a-43bf-8104-aea4502a972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea993423-481f-4db4-a209-06aa2fe02bae', 'volume_name': 'volume-ea993423-481f-4db4-a209-06aa2fe02bae', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1e2a27-f7d1-46c5-9905-6b29fd7eacff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e1e2a27-f7d1-46c5-9905-6b29fd7eacff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b1094e-78d2-4329-b87e-ee6a3298cc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:34 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Volume ea993423-481f-4db4-a209-06aa2fe02bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea993423-481f-4db4-a209-06aa2fe02bae', 'volume_size': 1} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801943689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea993423-481f-4db4-a209-06aa2fe02bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf65e02e6142495a9f0f9699b49d9c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:34Z,use_quota=True,user_id='055a5a92ced548b8b51475b1c33ee068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Creating volume ea993423-481f-4db4-a209-06aa2fe02bae {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:08:34 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:34 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae 1073741824 Sep 09 18:08:34 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:34 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae 1073741824" returned: 0 in 0.398s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:34 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae Sep 09 18:08:34 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:34 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae" returned: 0 in 0.239s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b1094e-78d2-4329-b87e-ee6a3298cc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea993423-481f-4db4-a209-06aa2fe02bae', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0154db-1466-426e-b146-347bf7b244e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:34 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Volume volume-ea993423-481f-4db4-a209-06aa2fe02bae (ea993423-481f-4db4-a209-06aa2fe02bae): created successfully Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0154db-1466-426e-b146-347bf7b244e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:34 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Flow 'volume_create_manager' (ec344204-7eb8-48a9-b1a4-27c1afdb789c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:34 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-9b6e3e17-42e1-4d98-a06f-4d0eb4eb1ccd tempest-ProjectReaderTests-883343447 None] Created volume successfully. Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Acquiring lock "cinder-ea993423-481f-4db4-a209-06aa2fe02bae-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Lock "cinder-ea993423-481f-4db4-a209-06aa2fe02bae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Acquiring lock "cinder-quobyte-ea993423-481f-4db4-a209-06aa2fe02bae" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Lock "cinder-quobyte-ea993423-481f-4db4-a209-06aa2fe02bae" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9201e3-4fce-4cdb-8f18-411d580aef4a]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:35 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae Sep 09 18:08:35 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:35 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae" returned: 0 in 0.356s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:35 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae Sep 09 18:08:35 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:35 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-ea993423-481f-4db4-a209-06aa2fe02bae" returned: 0 in 0.236s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Lock "cinder-quobyte-ea993423-481f-4db4-a209-06aa2fe02bae" released by "delete_volume" :: held 0.629s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Created reservations ['270ab4d0-c14d-4ea9-9e6f-52477a627694', '5c5dbb5b-6cee-424b-8bab-2430a1164198', 'c17f6842-d0be-43fe-bf07-019afacb5449', 'c26401c7-a9c8-4a75-804c-22d11a018e1f'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:35 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:35 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:35 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:36 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.246s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:36 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Deleted volume successfully. Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-ca3a13a4-a773-47b7-b1a5-ceb5f1bac36e tempest-ProjectReaderTests-883343447 None] Lock "cinder-ea993423-481f-4db4-a209-06aa2fe02bae-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Flow 'volume_create_manager' (00e97376-e4a8-4596-b9ab-5db19deceb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f79f96-4889-48b2-a0f4-808d0b660d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f79f96-4889-48b2-a0f4-808d0b660d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474948735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eb6456-1e21-436a-b887-1e9e6b6bf58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf65e02e6142495a9f0f9699b49d9c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:37Z,use_quota=True,user_id='055a5a92ced548b8b51475b1c33ee068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9742b967-a102-42b4-96e7-76d284018b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9742b967-a102-42b4-96e7-76d284018b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ad9d4e-5442-407b-b25b-b98d487900f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ad9d4e-5442-407b-b25b-b98d487900f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4eb6456-1e21-436a-b887-1e9e6b6bf58e', 'volume_name': 'volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0411c44-cfc1-441c-a4da-495266d638e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0411c44-cfc1-441c-a4da-495266d638e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188d1ddf-8d3b-49d6-b72b-62518c527301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:36 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Volume f4eb6456-1e21-436a-b887-1e9e6b6bf58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e', 'volume_size': 1} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-474948735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4eb6456-1e21-436a-b887-1e9e6b6bf58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf65e02e6142495a9f0f9699b49d9c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:37Z,use_quota=True,user_id='055a5a92ced548b8b51475b1c33ee068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Creating volume f4eb6456-1e21-436a-b887-1e9e6b6bf58e {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:08:36 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:08:36 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:36 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e 1073741824 Sep 09 18:08:36 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:37 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e 1073741824" returned: 0 in 0.400s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:37 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e Sep 09 18:08:37 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:37 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e" returned: 0 in 0.239s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188d1ddf-8d3b-49d6-b72b-62518c527301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86e535d-b4a4-47be-89c3-fcbaf6d9ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:37 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Volume volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e (f4eb6456-1e21-436a-b887-1e9e6b6bf58e): created successfully Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86e535d-b4a4-47be-89c3-fcbaf6d9ca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Flow 'volume_create_manager' (00e97376-e4a8-4596-b9ab-5db19deceb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:37 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-a4aa32ad-9bd0-440c-aa2b-2da9181896e9 tempest-ProjectReaderTests-883343447 None] Created volume successfully. Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Acquiring lock "cinder-f4eb6456-1e21-436a-b887-1e9e6b6bf58e-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Lock "cinder-f4eb6456-1e21-436a-b887-1e9e6b6bf58e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Acquiring lock "cinder-quobyte-f4eb6456-1e21-436a-b887-1e9e6b6bf58e" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Lock "cinder-quobyte-f4eb6456-1e21-436a-b887-1e9e6b6bf58e" acquired by "delete_volume" :: waited 0.018s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb58506-daba-4eb0-86ca-3fb076e76433]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:37 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:37 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e Sep 09 18:08:37 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:38 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e" returned: 0 in 0.359s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:38 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e Sep 09 18:08:38 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:38 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-f4eb6456-1e21-436a-b887-1e9e6b6bf58e" returned: 0 in 0.234s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Lock "cinder-quobyte-f4eb6456-1e21-436a-b887-1e9e6b6bf58e" released by "delete_volume" :: held 0.629s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Created reservations ['79ed99b3-2a56-49ef-8229-33ecd625eb88', 'a4a84230-da9c-45c1-9a75-cb281e740a19', 'f48abdf6-f98a-4642-8a47-4c147722aff0', '25d862cb-47e3-4fde-8e2a-fdb4bb3f3264'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:38 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:38 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:38 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.231s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:38 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Deleted volume successfully. Sep 09 18:08:38 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-66eddc53-01d9-4e00-8188-c6ad48e7dccf tempest-ProjectReaderTests-883343447 None] Lock "cinder-f4eb6456-1e21-436a-b887-1e9e6b6bf58e-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.flows.manager.create_volume [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87202) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Flow 'volume_create_manager' (c94c7f0a-147d-4422-96c1-fab4b3ae3458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4fd8b4-c6c7-4e7b-86e7-e142b1b07439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4fd8b4-c6c7-4e7b-86e7-e142b1b07439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496925317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bf2bf6-31ec-4eca-be71-b980d825f2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf65e02e6142495a9f0f9699b49d9c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:39Z,use_quota=True,user_id='055a5a92ced548b8b51475b1c33ee068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec61ce1e-a224-4820-91a0-bd09789d152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec61ce1e-a224-4820-91a0-bd09789d152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af979794-de0e-4d64-a295-d61d4648bde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af979794-de0e-4d64-a295-d61d4648bde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32bf2bf6-31ec-4eca-be71-b980d825f2fb', 'volume_name': 'volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e263e39f-3c8f-4fd0-aa5b-4d78a862a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e263e39f-3c8f-4fd0-aa5b-4d78a862a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dea03a1-d8e5-4804-bb2c-8e13e9600a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:39 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Volume 32bf2bf6-31ec-4eca-be71-b980d825f2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb', 'volume_size': 1} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496925317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bf2bf6-31ec-4eca-be71-b980d825f2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf65e02e6142495a9f0f9699b49d9c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:08:39Z,use_quota=True,user_id='055a5a92ced548b8b51475b1c33ee068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10851652-aa5f-4a31-aac2-e0678e962e36),volume_type_id=10851652-aa5f-4a31-aac2-e0678e962e36)}" {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.remotefs [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Creating volume 32bf2bf6-31ec-4eca-be71-b980d825f2fb {{(pid=87202) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Selected osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf as target Quobyte volume. {{(pid=87202) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:08:39 devstack cinder-volume[87202]: INFO cinder.volume.drivers.remotefs [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] casted to osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb 1073741824 {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:39 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb 1073741824 Sep 09 18:08:39 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:39 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb 1073741824" returned: 0 in 0.383s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:39 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:39 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb Sep 09 18:08:39 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:40 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb" returned: 0 in 0.232s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] <== create_volume: return (652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'} {{(pid=87202) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dea03a1-d8e5-4804-bb2c-8e13e9600a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb', 'volume_size': 1}' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d38036-964d-40e7-82f5-b1c2319030c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:08:40 devstack cinder-volume[87202]: INFO cinder.volume.flows.manager.create_volume [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Volume volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb (32bf2bf6-31ec-4eca-be71-b980d825f2fb): created successfully Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d38036-964d-40e7-82f5-b1c2319030c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87202) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Flow 'volume_create_manager' (c94c7f0a-147d-4422-96c1-fab4b3ae3458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87202) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:08:40 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-6521f2fa-2a30-4206-9e9d-733486bfb5f7 tempest-ProjectReaderTests-883343447 None] Created volume successfully. Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Acquiring lock "cinder-32bf2bf6-31ec-4eca-be71-b980d825f2fb-delete_volume" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Lock "cinder-32bf2bf6-31ec-4eca-be71-b980d825f2fb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Acquiring lock "cinder-quobyte-32bf2bf6-31ec-4eca-be71-b980d825f2fb" by "delete_volume" {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Lock "cinder-quobyte-32bf2bf6-31ec-4eca-be71-b980d825f2fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87202) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f0e94c-f519-4428-a9cd-55436d286c11]: (4, 'qcow2') {{(pid=88402) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:40 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb Sep 09 18:08:40 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:40 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb" returned: 0 in 0.346s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:40 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:40 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb Sep 09 18:08:40 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:41 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d/volume-32bf2bf6-31ec-4eca-be71-b980d825f2fb" returned: 0 in 0.239s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Lock "cinder-quobyte-32bf2bf6-31ec-4eca-be71-b980d825f2fb" released by "delete_volume" :: held 0.622s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG cinder.quota [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Created reservations ['32616805-d874-45a7-9c8d-fda78024b1eb', '114b61d3-5d84-41d4-87cb-78c3dc4a9dd6', 'e419c31f-537e-4fa0-a4fa-c1aa5b12754e', '18100667-ee36-48d1-89b8-17db207be19e'] {{(pid=87202) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf': None} {{(pid=87202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG cinder.volume.drivers.quobyte [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cf3d8762-09d2-48e9-b6b7-28f9213595cf'] {{(pid=87202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.lockutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:41 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d Sep 09 18:08:41 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:41 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG oslo_concurrency.processutils [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9fcdb15f7eb8caf4712ed09d1dc5a8d" returned: 0 in 0.229s {{(pid=87202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG cinder.manager [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Notifying Schedulers of capabilities ... {{(pid=87202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:08:41 devstack cinder-volume[87202]: INFO cinder.volume.manager [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Deleted volume successfully. Sep 09 18:08:41 devstack cinder-volume[87202]: DEBUG cinder.coordination [None req-831b26aa-c5b1-4c05-bd63-0b0e4c77b1ca tempest-ProjectReaderTests-883343447 None] Lock "cinder-32bf2bf6-31ec-4eca-be71-b980d825f2fb-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87202) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:08:51 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:SELECT=36,cinder:UPDATE=44,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:08:51 devstack cinder-volume[87202]: DEBUG dbcounter [-] [87202] Writing DB stats cinder:UPDATE=43,cinder:INSERT=10,cinder:DELETE=6,cinder:SELECT=19 {{(pid=87202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}